169 888 



IB 007 091 



AUTHOR 
'TITLE 



INSSITDTION 

SFOSS AGENCY 

BEPORT NO 
PtJB DATE 
CONTRACT 
MOTS 

EDRS PRICE 
DESCRIPTORS 



Tatsuoka, Ki'kUtni. f(, Ana Otht rs - , ^ , , , . 

Atti'tuaes -and ; PerforinancQ of 'Hilitaffy Students in 
Computer-Bastd 'Technical 'Training (Part A) f and] '\- 
In,str\ictor ■ Attitude lelated to-, the use of the PLATO' 
■^" System at Chanute (Paxt B)* ' ' ■ ' 



Oi^iv, , Orbana, CoBipute r-Ba aed 



Education' 
. , Washthgton:', 



IDENTIFIERS' 



IV 

Illinois 
Lab 

Advanced PesearchC Pro jects Age'ricy* (DOD) 
b.c. ^ ^ ' ' ' ■ • : ■ . 

MTC-H-23' ■ ■ ' ' ^ . ■ . ' , " ^ : - ■ . ■ 

■■ Jah 78 . ■ . ' :. , .. 

DAHC- 15-73-C-0077. - ' 

52p. * ' .. . .. .^^ • 

■ ; ^- . . ■ . : ' ' : 

'.MFO 1/PCO 3 Plus Postage, , • • . . . ■ ■ . 

♦ Achievement Gaiiisr Anaiysis of Ytfriancfe- ♦Computei- 
Assiste'a ' Tnstruction; *Computer prbgram^i E valuat loni- 
Factor Asnalysisi Military Training j Qu§stidnnaire,fe^ 
^Stuasnt Attitudes *Teaeher Att ItudesK i.Technldal • 
tdu cation ' . ' ' 

*PLATO IV. ■ ^ " . ■ \'' ■ ' ■ . 



ABSTRACT- . . ' ' ; ,/■ 

■ ' ■" A series of analyse's were fide to relate atti'tudlnal 

and achievenient outcomes, in an assessment 'pf ■.student, achievement an,d 
of student artd Instructor attitudes, made by the a. S^, Air -Force Human 
Resources Laboratory (AFHRL) and the' Air Training Commana (ATC) 'as 
■part of their, ioint Service Test of the PLATO IV system at Chanute 
Air Force Base. Data were collected on students and instructors in 
three treatment; conditioni- ' (1) instruction with the PLATO-Based ' ■ 
Training System' on the content of the camnon course segmenti " (2) • 
instruction with several of the pLATO lessons, with the same material 
presented via conventional classroom lecture methpas; and (3)" no 
PLATO instruction. Achievement data were collected and pre- and__, 
post-tests, ana attitude 'data were collected in'one ins'tructor and 
two student que stiQi:i,naires, "analyses, indicated that students' 
positive perception of effectiveness in PLATO lessons, was a,ssociatea 
with better achievement gains, and frustration and' stress of learning- 
led to less favorable achievement. Positive attltuaeg of Instructors ' 
♦oward the PLATO lessons had a favorable effect on the s+uaints. 
(CMV) 
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.introduction " ^ 

» ■ ■ ■ . • ■ 

^^A. Lynn Mlsselt 

/e^sment of student aehievement and of stujdent. arid 
. itructqr, *'at,titudes during .the period from January^ .1975, 
. y/o' Septemer ,^as mad.e by the U.,S. Air Fopce Human^ 

^ y.Respurces I'aboratory (AFHRL) and the Air Training Command 
/ (ATC) as part of, their jointly-conducted Service Test of the 
/ PLATO ly Syst.em at Chanu.te Air Force Base. Analysea of the 
aehieveraenb .and attitude data were carried out by the g 
■ Mllltarry. Training ■ Cettters (MTC) arid PLATO .tducatlon^I 

Evaluation and Research (PEER) i-roups of CERL . and' will be 
reported, as products, of the AFHRL/ATC- evaluation 'effort . ft 
- Is the. under^at-ahdlnE of the M,TC and PEER groups that the' 
, AFHRL/ATC reports wil,lV treat the instructional effiectiveness 
, and Instructional ..imp,adt results of the Service Test inde- 
pendently and 'hence, wiliv not attempt ,to\ rfelat.fi ach-ievement 
results to •attitudes. ; V^beJ.ieve, however, thatl'a compiete 
\ examinatiofi=- of the aehlev#^ent-qttit.ude helatianship will 
enhance the understanding the^ outcomes\ o . • 

Service Test and may lead to\ useful vgerierallzation&. or 
. hyjDoth'eses.' We-'have. plarihed ,\ th-eref ore , a Xserles of 

ad'ditlonal. analyses to rela'te "attltudlnal and achievement " 
outcomts. . - -• , - . ■ \ \ , 

■ ■ , . .... - ■ ■ s\y V , , A . X w ,. ■ , 

Database Available from Cjijnute SgrviQe Test 

- . . - . ; . . \, . • , ,. V " ; r ' . - 

. In order to assess the ef feetixveness of th\e PLATO IV 
sy-stem. in a .military training .environment, persocnnel at 
Chanute AFB dey^el'op^d a set 'of IlATO lessons' cover ing"''' ; • ; 
cognitive elements pf a-|course segment in element'^ary auto- 
,«motlve principles / This six-week segment formed a\ basic, 
' common core of ftiaterilai Ifor four special- purpose v#h.lcle\ / 
re.pairman gou.f ses% \That| is , stude assl|ned to each ■ 
'tjie, four specialty courses all received similar iristr\uct,ion 
in , the- fundamentals qf aiitpniotlve .mechanics before br'^ncFiing 
of f _ for additional inistrutafclon in the maintenance of vehi- \ 
^cles ^in their -b,wn sp^^ialty (e.g.', fire trucks, tow trucks, a 
endloaders , etc . ) . -This coramon" course ''segment was ta-^jgh.t in,\ 

■ four gunits or blocks, averaiing 1 1/2 weeks' in length ,• with- ' 
, a . Block Exam administered at the end of each block. 

v PLATO was introduced in the four target courses, on a V 
staggef-ed time schedule so that classes entering' one of the 
■courses befan to ; use" PLATO as in integral part of -their 
.instruction as'- earjly as January, 1.975, while conventional 
i'nstr,uction was retained in the other oouttses until later in 
that, year. By dctober, 1975, all speclal,purpose vehicle '"'' 
repaifman stydents were receiving Instruction via what ' 

■ Chanute AFB c'alls th-e PLATO-Based T^al^irig System.' Under- 
this system, PLATO itssons compr.ised 173 to 172 of the 
instruction in the six-week "common course 'Segment . " : The 
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■ ■ .■reniarnlng Instruction ^progf-atnined teyts,V " , 

, . films, and rabo;rator3(' exercises. ' • ■. , ' 

^ . ' The C BE materialsx usbd for mainline instruction ■ eb,n-" ' ' i ' ' ' 
sisted of ; thirty five tin-Tllne lessonsf ■ tptaling aboVt ^^J^ - • - f 

hours in length, Each of these lessons Had a criterion^ ' ' • ' 
referenced test at the end which was calleda master '■ K 

hl€ve a' " ■ -r..^ * 



validation exam (MVE). Students who failed achieve 
passing score on a lesson's MVE were required\to review thje 
lesson and to repeat the .MVE-until they scored\ aUtTve the 

'. .minimum criterion for . mastery .\ . ■ 

\ ■ ' ■ ■ -. • _^ , , ' ' -/'- -^ ■' 

Treatment conditions . During the' period from January 
1975, until September, 1975,' members of th© Joint AFHRL/ATC 
evaluation team collected ' achievement arid Xattitud^ data 'on * 
students under three treatment ■condit^onff. ' The first qf 
these, the PLATO-Based or PB. condltidn , consisted of instuc- 

, tion 'i^ith the PLATO-Bas,ed Training System on the coVnitive 
eonterit of the cbromon course segme\nt. In the second condi- 
tion,: the .Conventional^PLATO or' CP ■condition^ lnstru\-tor . 
assigned many of the PLATO lessons \to their studenti\but * ' 
also presented the same material via oonventionlra. lecture ; 
methods In the classroom. 'Students in the third condi>tioh\„ 
received no PLATO Instruction and hence were designated as'- 
.the Mon-PLATO or MP group.,/ 

Achievement data . The .basic, achievement data'oollected 
' fot- the/AFHRL/ATC ■ev-aluatlon from January, -igYS^, to Septem- 
ber , 1975 included scor'es on the four block exams,sfihal > 
grades- (which \were actually just the , average of the block- 
e-x^m scores >, arid results : from: three adml'nlstrations of a I 
social •topical . test developed by the AFHRL/ATC evaluation f* 
team. The spfcial topical test contained 30 items ov^r five 
topics covered, by, PLATO lessons and ao items ^over an 
.^additional four topics that wire not presented. by PLATO. 
The test was admin'^lstered to students in all t\hree treltment ' 
conditions, on three different' oecasionsi 1 ) . as a Pretest on 
the rirst daj df ■ instruetion , 2)* ,ps: a posttest Immediately 
following, the 'cbnimon course segment ^ (this administration was 
called- Posttest ly . and 3) at this 'ep/of each of the four V 
-specialty courses;. This last .admlnla.tratlon was called ■ 
, Posttest . II. ■ ' ; \ -r ■ ' ■ 

~~: -— — — — — , : \ ,1. : . \ ■ ■ ■ . , ■ 

■ / . . . ■ :■ \. ■ , ■ ■ . ' ■ ■ . 

/.ttldudlnal datia . ■ The student attltud.e questionnaire 
^ ised Irt the AFiiRL/ATC, ^valuation is;.*reprodubed/in the . 
'Appendix to this ripbrtw The items' In Sect ioii .1 (called 
the "short fo^m" ques;tionnaire) were ^administered to the ' ' 
PB. and CP students after each black of in'struction in .thp 
the common course segment, fhe NP students, meanwhile, were 
asked*to complete a similar set of Items -which dealt with 
attitudes toward traditional instruction rather ^than' toward • . 
computer-based education. The items in Section "ll sought to 
measure .attitudes toward- the PLATO-Based^ Training System 
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. while, those inSeetlon ili asked 'about the affect iVe status 

ar-ous^d.;hy. working with, the PLATO system . • The items 111; ./ 
K. 'Sections II jand/IIKwere Goiiectlv^ referred to as ; the 
■ "lorig forrn.'\'fiqyestlojinairer Bec^ experience ■ 

. with tfompjj^er-baSed.'e'duGatldn , the - long form questjionhaire • 
• was. administered only to the two groups whoS received PLATO ' 
, l;ns,tru9tion. It was aamlnistered at the end of the-common 

cburse \segment jus on^into 
,* In'structlDn in their' own vehicle repairman' special t'j.es. 

\ ^ TJHe .attitudes of Iristructbrs toWard the^LATb Based 
V %f^ln^g System -^eTm mlBo me^surQd^ b% - .] 

Unfort^unately /-.it; i impossible to relate instructor atti^ 
^ :%tudaridlreQt.^y; to^t^ afctltude or perfofmanoe. of their stu-- 
^ tents _^eqause of ^ the manner in which Instrudtor^S; wfere given 
teachi^g^^assi|/imaRts in the^ target courses . * ' 



' II LONG FORM OF ATTITUDINAD DATA 



' ■ ■\"''\..-^ \'\\: • Kikuml Tatsuoka . ^ ■ 

order to VJV."pllf'y the*'fe6 attltudlnal- it.ems into " 
■ sever&l. igroups W \related Items, Factor analysis was' per- ■ 
'•■foj"m€d hx\ the, sdores' of ^questlqnnare Items. The responses ■ 
- to the 66; Iteps^yf \thV long form attitude questlorinalre (45 
. Items frjoWsectian. CI, from. section III , -ploas one', 
;A.:vltem Indicating treatment' oondition) were first subjected to 
;a Prihclpil. Components analysis,' The largest 'seven elgen- 
valuesv,^erej 20,45lBv ^^.0^J2, .2.25-35, l,g710, and-»l .-6367 .■ : ^ 
Then the factor rnatrix affsdciated with the largest seven 
principal corapohentW' was ndtated by the Varimax ^ procedure . 
'. The -as 'items having >^fac tor loadlrefs'' larger than .5 irt^ abso- 
lute value were extr\acted a^ a .common factor of this 66-item 
ahaiysis,. THe 'coinrnon faator, had a vat'iance'' qf 1 5 . 2'5"5it' ' 
and-,,a \percentage variance of\ET. -1905, while the totfl sum of 
. comnmualities was 5,6.i05€. Iwdeed, many Items within the 
questid-nnaire' were clustered together' 'as ' a edromon' factor. 
. Thirty-nine items 'in this first" factor, had loading^ larger ' 
"..than ,30 in a'bsdlute value. / ■. j ' ^ ■ ' 

■ -v ^' ' , . . " ■ " V / : - - : " - : ■ ' 

\ All fef th'ese items indicated positive attltucies towardi 
. the PLATO program; FJowsver, a close examlfTatlon b'f ' items m 

t^is factor Indicated that.there were thre#.kin'd,5 of favor- 
•able attitudeis toward PLATO : the fir.st. was persdnal- involve- 
ment with PLATO; the t;he second tj^pe represented Ae ' 
; respondent 's perception.; of the eff'ectiv.fness of pSto . , " , ' 
\les'sons » ' the third was more af f ective , " with responses such • 
as, "Workljig with,^ PLA.TO is fun ,*-§nj'oyable-, "' andf encouraging. " ■ 
The items: from Section II having loadl'ngs larger than .70 iw 
\.al^solute value, were ,3,- 5,, If i " l-^i \ 1 a., 1 9 ^ f 5 . ns, iiU. 
Tr^eBe- i,t«ms probably indicated fl- favorable,, attitude' towar.d 
■ pmiO without any noticeable rtservatlon . /Thus they will" be- 
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ABSiy^itB^ BB t'^pB l ttems. The items having, lowei Id.adings 
also, ffon Section II were connected with the 'second kind of . 
attitud^', a more objeptive statenaertt of" the, perception tof • 
the fiffectiveness of -PLATO lessons. Theael items were fay 22, 
33, '^1, and ^45. The third kind of attitudes wer^ frdm 
Section III and they correlated, highly with b'oth the first 
and the secsond kinds of. .attitudes. It would -be interesting 
to, know. to what extent the mechanistic and Impersonal CAI 
lessons will work ^feotlvely and aohieve the aimed goal of 
training, - . ' • , . — . ' - 

/ . . ^ ' — ■ ' ■ ■ ■ ■, , - : ■ . ■. 

Analysi s of trie items In Section III. Since our / 
Interest was Xo relate th« attitude responses to tfte per-' 
forniahce result.s , the comftion factor from 'thli anaiyslsrijseeraed 
too genSral and ambl|uous for our purpo'ie. Therefore the ■ 
4.5 M terns in section 11 and questibn 2 in, sect'ioriwIII were 
separated- from the items in. Section III. Items 7-18 in seo- 
tion HI and these. 46 items were analyzed independehtly in 
the, same . w%,y as the 66 items Wer* analyzed. The result of 
analysis for the affective items 7 through IS in Sectlonlll 
are shown in Table 1. The eigen-vfilues, of the first three 
components were 6.5203, 1,551&, and .7927, and the cumulative 
percentage of. the first two cdmponents was -eS. 626.9 . < , 

. T^e 1 v: ■ "v , - . '■ ' '■- 

Variance in the Two Factor Space Ae-eounted 
for by each Paotor Following Vai'lmax Rotation - 

- - ■ , ' ■ - - : ■ . . , 

V Factor ■% of variance Cum. of % of Var. 
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■ : . 1 ■ 3.5'720 ^ 37. 4516 = ■ ■ 

'V 2 2.9/769 68.6269 ' 

These factors were renamed FVI and FVIl, r.esp.ectively, and 
were retained in further analyses. ' . 

. * 'V, ' " - ■ ■ ^ ^- ' . 

I -. Thg ^ ana^lyads of the Items in Section II , ' The 45 Items 
;and Item 3 In. Section III were ractorized. The principal* 
^ component analysis of the ^6 items showed tigen-valuee of . 
. 1^."l|61V3'?300H. U9100, 1 ,5955, 1, 4763, 1 .3580j ^and 1.3020 
; as tffe flra€ se^en components. The variance of the first 
; principil Qomponent was istlll large relative to the other , 
component's and the percentage of variance was almost 31|/ 
Varimax rbtatlon was then perfornied on. the. factor matrix " 
associated with the first seven Qompoh^ntSj wh^li accounted 
for 6\^56$ of the variance in the original i46 var iables 
The results are sho^wn in Tables . 2 and The common factor 

' frdrn this 46-lt_em ^analysis was very similar to the one from 
that in which all the 66 Items were, used, exoMpt for few 
It^ems, Table 4 shows the comparison of these tkp common 
/factors, 

■ . '/ '' , .■ " ' ■ 
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.■ ' ' ' ■" Table 5. . ^■^■\ - ' - , 

Varlang^ in the , Seven Factor Igpace Appeun ted * 
for by ihcht Factor* fo^llpwAng-Varim 



Factor 


Variance, ' ■ 


; %. bt 'var ignce 

7' 


• .varl-ince 


' t 




H\. 1806 ■ ■ 


■ 41.' 18 06 




. 3.71ST ■ 


, . 14.7.825 V 




^ ,3-: ^ ^ 




. ' 10.5370 J 


' '^.66.^5001 




. ' 2.6218 ■ 


■ 10.4463 ■; 


." : 76,. S464 




2 .545^' f 


■ '10.. 1412 


47^08'! 6 


•6 


^ 1.6264 ' - ' 


. , p. 48 01 - 


• 93 .'5 67 7 






• 6'. 43 12. 


: 99; 9989 




' 1 


'f ■ y 

Table 3 * " 






■ ^. The Item Grouping by ,th^ Factors ' ; ^ 

i.(;^'i,4D) ■2(:>.4o) 3< >".'4q,) ',4( >.40) 5(.>.ii0); 

3,5,6,9, . 1f,-23, ■ 2,it;7,a,- 21,23,' ,1,15,.lfe, 
12,13/16, 31,33, .10 25 ■ . 42 i-;; 

17, 1^8 > 19, 34 ,36,^^ 'Tv - ?, : 

22,29,30; 37 ^. ; ' ' v ' ^ ■ 

33,35, 41', ... ■ - ; ^ 

43,|4,45, : . V , 

A. . I \ ■ ■ ■ ■ ■ 

■ Tabte 4 ' ... ■ ' 

Whe Common Factors in the 66-item and 46-ltern Analyses' 

66-item. Analysis 46-iteiii analysis 

Iloadings !>.65 ' 3,5,6,9^13,17,18"^ 3,5,6,9,13,17,18 

19,30,35,43,44 ) 19,30,35,43,44, 

' ■ ' 2C1II) 2(111) :v ■ 

.65>Uoadings i>.40 10,12,22,33,41,' 12,16,22,29,33, . 

■45 iil ii5 

Item 10, "The^equipment rnade it drfflcult' to Qoncen-. 
trate on the /Gourse material," was dropped, in the i|6^item' ' 
analysis but ^niw items i 16 and 2g, came in there. Items 16 
and 29 were- ''Material which is otherwise interes-trng can be 
boring when presented on PLATO," and "I was awaKf of efpDrts 



/-no; suit the' niatigrial, specif loally to^me," respectively, 

' 'The jetjond factor in the 46-ltem analysis hacJ almost • 
the same Items as the third factor in the . 66-.itein analysis. 
, The students, felt too much material 'was presented and could 
not work .at-'th.elr own pace. Also; they felt /uncertain about ■ 
their performance and the situation made them tense. They ' . 
complained.;, that irrelevant .and>arnbiguous qi/estion? were ^ 
asked in the lessons. ' ' 

The' third factor in the ■^6-item analys,is■'had the same 
attems as the. fifth factor Iri: the 66-ltem analys is , ' except v . 

for item. 7, "1 was more involved In operating the eerminal; 

than in understanding the course material-." Items that 'ftfll 

in the factor were item g, "The leafrningrwas too mechanl- ' 
' cal".; item 4, ■ "The equipment interfered with learning" i and 

it^m 8, "No one eared if I learned or not, so 1 felt isolated 
■ arid alone ." ' , ) 

.The fourth factor in the i|6-ltem analysis shared some 
i'tems v|ith- the first, seeond, and third factors' in the same . 
46-item" analysis and it .is' very difficult , to give an ade- 
quate interpretation of it. . ■ 

The reason that we reanalyzed the original 66wit.em 
analysis, presented in "Chanute Report" by reducing, the 
number of items to 46 was that the first factor (common ^ 
factor) had too many items clustered together and the other 
factors were of .only few items. Mor^ver, we felt, the common 
factor had to be separated, out into two groupSj those having 
tilgher loadings and lower loadings* in other words, the type 
I and 11 as we mentioned beforel Thus the i)6-item analysis " 
did not give us satisfactory results, so we separated the '46 
n'tems into 2 subsets ofitems: one' containing the items " 
which expressed a favorable attitude toward PLATO and the 
other containing the' items which expressed a negative atti- 
tude toward PL,AT0. .The 25 items having- loadings greater than 
or 'equal to . 3 in abso4ut.e value oh the first f^a.ctor we^' ■ 
the subset of faVorable items and the 29 items 'having ftctor 
Tqadings greater than or equal to .3 in absolute value oh 
the factors other than the first one were the second subset 
of items. These items in the two 'subsets were as shown 
below. . - .. / ; ' 

^. The llst.-of items analyzed separatfly. - : 

- . ' ' ' - ' ... ■ " , ■■■ ; . ■ 

Subset ■ of 26\i terns. i,5, A,.7vg:f 18, 19, 22,24 

: ' , 25,sgV5^5;S3,3.5,39i4l,4 3,44,45^yB 



Subset of 29 items ^1 , 2, 4 , 7 ,8 , 1 0 ,'1 1 , 1 2 , 1 4 , 15 , 16 , 20 , 2 1 , 23 , 24,. 

< 25, 26, 27,28, 29, 31, 32*34,36,37*38, 39, 40,' 
42. , , ■ 



.,^^v V.,.' . 



. - . . JhG 2 6 -1 1 ern ^5 u b s e 1 1. W e ii|a^yzed ^the %m subsets se^r^' 
.ratel"y7'"^t firsts a prlncipal'cornppnentS: ahf 
on the 26 it^m subset and the -resulting taotbr mitf^lx Was 
rotated by\thif-varirnax method.- The. fir^t^ facto r>4las pf ; 
items having loading^ ^with absQlute/ vplues gi^rater: than or ■ 
equal to^ .65 In Tabled except for items. 33: an4 2(XII). This^ 
factor was named FI and retain&d I'or latSr arialysls. . The - 
Items having lower loadings in *the 46.*-'itern analysis^ ^hlcli 
were shown in Table M/Cia, 1 6 , , 22,;-€l , 33 , 4r)f^rmed the 

gecond .factor in this analysis frrtf it was narned" FII;, .FII 
became one of the d.isc riminatGrs; of studen ts as 
is Shawn later in tfhls chapter , V Bie >n:iewiy extracted th 
Bn6 fourth fsdtors in "this analyses Were ignored and not 
used: in the fur ther analysis; V' /' : : - 

* The 29-1 tern subset was analyzadv U the same proce- 

dure as wlthvthe a6-ltem subsetV The- resulting first factt>r 
-wa^s of the items in the second factor of ^6-item analysis 
(1 1, 23, 31, 3^, 36, 3?) and of the fourth fac tor of .the same 
analysis (21 , 23, and 25) 'togetheK, The second, factbr^was of 
th^-lfc^rM-toHrfaie--fyrfth fac tof -r0-f--th-r7^^€w^ ( 1^- 5T^^ 



^0) in Table 3. • thenhird factor included the itims in the 
factor 3 in T^ble.3 (2, "7i sT^'lO) . /These three new f&etors 
were; retained in late'r analyses and were designated Fill ^ 
FIV, and FVvl^'^he report. \^ 

^ ■ ' '■ ' ' . * 

k Nummary of the final; factors la given in Table 5. 



7. ' Table 5, " ■ 

= ^ f , = - 

Eight Factors .Extracted From /, 
the Student Attitude Qufestiannaire 



_ ^ ^ FACTOR I / 
■ .- -1^ ^ ■ ^ ^ ^ = ■ ■ ■ t ^- - ■ 

' - ' personal' lnvoly;efnent .with PLATO,, or 

^ . ^ Acceptability < 

3* I felt challenged to do my best worlc* ' . ■ *75 ,f 

5. .1 felt as if someone were engaged in 

QOnversation with me . ^ ^ ^ \ ^ . . 69^ 

6, As a result of h^aving studied by this 
method^^I am interested in learning mor 

. abo'ut 'the subject matter, , ■:\^- ,69 . 

9 . ' I felt as if I had a pr ivate - tutor . . ; , .67 ■ 



t ■ 



9: 



'13. My feeling toward the ee.urse ma'terlal after ■ ■' 

I had oompleted the PLATb, portion of the :■ ; 

■ . course ;was favorable. ? , . T .66 



.17;, 



I was satisfied with/ what 1 lear ne|!%hlle 
taking the course. • • . , «^-^f:, % 



, . 62 



18, ^' In view of ^the amourifc I learned^ this method • ' 

seems superior to Glassroom Instruction for . 
' many courses, : ; ^ , ' : ' ' ■ ^ .75 

, ' \ - - . " * * ~\ ' ' , ' .... ' ■ ^' s 

19. I would prefer PLATO to traditions InstriJction ' .73 



I was .encourged by the rasporises given to my : 
■answers of ^ questlohs . ■ / *5'8 



43. The lessons ofe PLAtO were * in terest Ing and 
really/kept me Involved. .^^-^^ '53 

■ • ' ^' ^ ' ^ . ^^Sm- . ■ . \ - - . ^-^ ^ 

44, What I learned from PLATO made the olassroom and 
Laboratory instruct Ion ' easier, to u .68 



■ rACTOR 11 r \ ' ■ . ^ ^ .. ^ ' 
Perception of ef feGtivehess of PLATO, 

12, PLATO, as used Irt *thls course , is an Inefficient -^.51 
use of the student ' s time. • 

22. The responses to my answers seemed api^ropr late * *49 

33. 1 felt I could work at my own pace. ^ .66 

35* Material which Is otherwise boring can be . *61 
. interesting ' when presented by PLATO^ 

■ ■ \ ■ " " '■■ . * • . ■ .-^ V ^ 

41.' Computer-asslated instruction did- not make It -,60 

possible for me to learnr quickly. ^ . ' ; 

il5. the PL.ATO lessons: were dull and difficult to -.57 

^ follow. ' '• • ' 

:u2'.,v As a student, 1 do my best work with .60 
"V PLATO l-fissons. . ' 



n ■ « 



: ,= r. 



t 
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■ ' AlietlatMn. - ^HA'TO 'a's a - task , not learning 
■11. The situation niad|' m>q' .©i t'e. tense. : v 
• VH: I . felt' frustrated bV 'the 'si^a-tlon . 

20. PLATO Instruction is 'yUst Ranother step toward 
.de,-personallzed instrucblo^. 

21. 1 Was conoerned that I rnlg!_ 
• understanding the material , 

\23*. I fekt. aacertaln as to my performance Ih tfie 
\ •progranimed course relaxlves to the perfprmance 
of. others; ■ . - , / ' ^ , > 

25. I fourid myself. Just trying to get through the 
' material rather than trying to learn. ' - 



.56- 

t 

'." .49 . 

-59 

\48 



28V>"i : guesaed at the answer s '^to some questions.. "^.52 

31 . :In iew of the Vi^e al lowed for'^ learning ^ I ,67 
|^el| ;too much md%erlal was presented , 

34. Questioijs were; asked which I felt Were not .57 
r^elated to the material - presented , , 

36. I coiJld ha^e , learhed more if I haan^t felt 

pushed • \ ■ ■ ^ : ^ / 

37. I was givert answers but stll^l did not understand *58 
the questions. ■" 



. ^ FACTOR IV ^ : . 

' \ Anti. System 

1, Th^e "method by which I was told whether I had ^ .65 
given a right or wrong answer oecami monotonous* 

15, I found the cpmputer-assisted instruction \ ^ ,61 
a pproach /in thi s cGUr se to be inflexible,. " 

40. While on PLATO^ I; enoouateDed^ mechanical . - " .60 
mal f unct ions . ' - , . ' ' ^■ 
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' _ . '. ■ . ■ , FACTOR V ; / 
. . . ' ■ ■ ,.. Impersonal , fiLATD . 

; 2. Nobody really cared, v^ether .ljj^ned,: :" ,. 
the course material or not. " 

^1. I felt .isolated jnd aions. •: . ■ ; ' 

■ 7. I was more^involved.■irt operating the^-tfirmipal 
» than, in understanding the course matefial." '- 

lo: THe equipmient^p^e It difficult to Goncentrate 
• on the, course mAerialv ^ . V ■ ' , 

. . 16, MattriA v^*rf^i$. otherwise interesting '(dsn be 
boring when pr tinted on; PLATO. . ^ 

% 24, l ;was hot concerned 'v^^en 1 missed a question 
; bec^Uae nobody was watching me. " ■ 

29- I was aWare cT efforts to suit the material 
specifically to me, 

38. The course Tna'terial-was presented too slowly. 

■ Positive feeling toward- PLATO, 
Working with the PLATO systems- ' . y 

(III)-: . ' ■ 

7. Is fun. . , '' ' ■ 

9. Is ^challenging. "- .f^^ 

12, Makes; me proud of myself > 

16., .Is^ enjoyabla. ' ^ = ^ 

18* Is exciting. . . ^ . \ . 



; . ; . ■■ ; . -FACTOR VII _ ■ , . . ■ 

. . Negative feeling -toward PLATO , / " , 
Workirig- with. the PLATO system: ■ ' * * 
. •8,./ fs, frustrating.. , ■■ ' ', '. .81 ■ 

10.<^ Is ■ annoying; . a .gg.-,, 

^11. Is confusing. •• ' ^. ' A, , .■,v;;-':';r ,; ■ v 78; ■ 

.13. Is bQring,\ - • v /gg ^ 

* ' ^ . ^ III, -MEASURING THE GAIN SCORES ' . / 

. - . = Kikumi Tatsuoka 

The achievement data collected for the 'evaluation study 
of Chanute AFB CBE project suffered from low reliabilities' 
of the tests, hence .there is a strong possibility ttiat the 
error of measurement on the test scores may wash away the'^ 
correlations of the attitude scores with the achievement 

^ scores, if we use the observed scores that we have now.= In 
order to avoid the profalem of error of measurements /' we will 

v:^yse a special technique \that ha& been developed recently;' 
This problem was called to the ^atfeentlon of educatiorfal 
measurement specialists, in connection with measuring'^ the 
gain scores of a posttest iprom. a pretest. 

Measuring gain scores has. been used in research in 
education and psychology even t-hough it has some consider- 
able problems. In many situations Such as. evaluation of 
educational programs, gain, scores appear. to be the natural 
measure^^to be looked into. " 

There were three major persisting Bi lemmas • "low 
reliability and error of . measurement , " "regression effect," 
gnd "over-cdrrection, under-correction." Ever since E.L. 
Thorndike ,(192,i<) pointed out these' dilemmas, measurement ■ 

„ specialists in. education , and psychology Have tried to oyer- 
come the diffioul-ties by suggesting yarious methods to- est-i- 
mate gain scores. He looked into the reliability of" the . 
difference ■between 'scores of two tests, and showed that this 
reliability is lower than the reliabilities of two tests 
taken separately. This fact was explained in that errors of- 
nieasurement in both separate tests affent the .difference 
score and whatever was common to both measures was cancelled 

,,-outr in the> difference. In our study, coefficient alpljp of 



pretest and posttest J were .3960 and .6300 respectively. 
But the reliability of simple difference scores was only 
• 1047| which was smaller than the reliability of either . 
prfetest or. posttest I," _ / , ' = . ' ' \ 

^ Cronbaph and F\irby C1970) sij^gested the usf of multiple 
regression, that is, . to regress the true gain soore on ^the 
space /span>ied by both tests By adopting a multiple regres- 
sion approach, they succeeded in avoiding the persistant 
.proble0iuo^f^:>w the ^^Same^ thing ^ . 

Indeed , estima1/ing th^^trute g score by -the multiple 
regression metted provided very efficient gain scores. 

V The simple differeTice score typically has a aegative 
.correlation with the pretest. Hence it implies that if 
individuals wi th high gat;i scores are to be selected, there 
will be/an over-representation of people with low pre-test 
scores as an artifact due-, to^the negatlv.e correlation 
between gains and pretest scores. The method of using 
regression gain scores Cor residual scores) was. Introduced - 
by Cebois ( 1957) and Manning , C 1 962 ) in ordler to ^ avoid this 
dilemma. Regression gain has a zero correlation with the 
pretest. This. gain score was obtained by subtracting the 
predicted pretest score from the correspond ing posttest 
score. We calculated the gain scores by regression method 
also. The resulting gain has^ zero correlation with the 
pretest and .86 with posttest^ I* As indicated by O^Connor 
( 1972^ and .Linn and Slinde f 1 977 ) i the reliability of^^^ ; 
regression gain is as low as that of raw difference scores. 
Our regression gain h^as a rel iabll i ty of . 33 which is. higher 
than the reliability of difference scbres. But it is still ' 
very low, and therefore it Is risky td^ make any decisions 
about individuals on the. basis of gains from pre- to \ 
posttesting periods on the basis of this regression gain 
scdre. It is possible to- observe some individuals with 
large difference scores,' even without any real change. 
Knowing that the rel labll ity of our regression gain was only 
•33?^ we investigated the rel atlonships between performance 
scores and attitude scores and compared the results with 
those we obtained using the multiple regresslo^n method. 
Applying this methoti , we obtained gain scores* having a 
reliability of .74, / " 

^ The calculation process of estimating an individual true 
gain score by the multipre regression method that was intrd-, 
duced by Cronbach and Furby (1970) was tedious and compli- 
cated. If other measures than pretest and posttest were used 
to step up the muTtlple R, then the procedure would be very 
messy algebraically and numerically. A mathematically 
simple method of regressing true gain scores "on several 
variables -was ^deyeloped by the first author of this report 
(Tatsuoka , 1975 ) • the procedure made it . possible to separate 
the reliabdlity (squared multiple R) of the estimated true ' 
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gain info the InGreraent 'of r2 proi^lded by :each variable 



score Xg-Xi", with x^ by 



The reliability '^f the differencel 

posttest I and xg .by pretest, would be caSculated first, 
then the. additional contribution by regressing tp-ti (true 
gain score) onto x"i and xg- would be cal cul ated . The 'sum of ' 
both values would be the reliability or squared multiple R 
of .the estimated true gain scores by the mult'i'ple regressidn 
method. Table 6, gives the result of numerical calculation 
applied to one pre'test. and posttest I. 'pie estimated gain • 

• score of tg-ti, obtained by regreBsing it oh jci and' xp^Wili 

■ • ,;- ;be given by: Rlttg-tvU] jXg) . The^ esblhi.ated gai-n;. score of , .., \ 
tg-tp using-x^^ xg and -the scores of .'Slock .test 2.ts giveli^ 
V" by RCtg-ti i x^^Xg', B^), etc.^ . V ■ . ' ' " ' 

• . . Table 6 ,. 

. ' Tlje Estimated True Gain Scores Obtained by 

^ Multiple Regression Method • • 

Variables Incremental r2 Reliability (r2) 

■ ^2"^1 , . ' ^ . 1047 

Rrtg-t^ ,xpxg) .63578 .74048 

S^t2"£l!^1 Xg,Bp): ■ .05894 .79942 

■ .R(t|-tj!xj|x|,B|,B3) ^ .1.1650 .91592 • 
R(.tx-tT | xy,Xg,,Bg,B3,Bj^) .02186 , .93778 

The numb>r of students is 110, and the religbiHties of the 
pretest and posttest I are .3960 and. .6300 respectively., 

, - .The reliability of the difference score was only 

• 0. 1 0470 but the multiple regression gain increased to .63578 
which is six times as much, as that of the difference score. 
We use a notation of R(tg-t^ I Xg-x^ ) for 'the regression of 
true difference scores tg-t^ onto the difference scores' of ■ 
pretest scores from posttesti, where xg stands for posttest 
II and x^ for pretest. ^.RCtg-t^ I Xg.x^ ,Bg) was the true gain 

- • that was regressed on pretest , posttestg: and block exam 2, 
Eg.. The increment of squared multiple RVby adding ■ block 
exam 2 to predict true gain score in R (tg-t I Xg i x . ) was 
. ., ■ . 05894. By adding iblbck-tests, 'the increment of .71650 in 
squared multiple R was calculated. Block exam- 4 had an 
increment of .02186. The rate of the increment by block 
exam 4 ■ suggested that the PLATO lessons in block'3 contri- 
^ . buted most significantly to the gain measurement by the 

special topic al^test given at the beginning and end of the 
program * . ' " ' > ; ,' • 

Table 7 shows a comparison of traditionral regression ■ 
gain and multiple regression gain using the pretest, post-. 
. ^ test , and, Block tests 2, 3 and ;4; R(tg-ti i'xyf.X2»Bg,B3. B^) .■ ' 

ERIC .;. ic ■ ■ 
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'm.. . fv -v. 



They!*<g^;e expif'ess'ed as A and B, respectively , ;4n" the 
following tablq.. .' . , 



Table 7, 

Conrelations .of the Gains wl,th Various Tests 




, / pretest 



/ post test I 
posttest II 
final grade 

block 1 : 

bloek2' 
blocks 
blocks J- 



,'8643' 
,2677 

.:. 3^3 i ■ 



B 



- ■ 6fefl* 

. 45-472 
.48.4 i 



.381 f 
. 1603, 
.6047 

.3422- 



It is\^lnteresting to note that the expanded; multiple 
regression , 'gain had larger, corrilatlons:^ wi th posttest 

3; 



II 



flna^ grade ^ and block 1, 3; 4 tests than the correlations oft 
^^the traditional regression gain with these/tests* Since the 
"exftandetf^ multiple regression gain had/^a re^liabllity of ^ ' - 
*9378^^ the estimated gain scores were very 



close^ to' the true- 



galh, tg^t^. ■ It i^s reasonable ^o^ assume /that block-tests 
would affect 'the gains because the gain should be a result 
of learning throughout the program and %lock exams were the 
me^asures of each learning segment of th/s period. The ; 
correlations of the regression gain wit^h block tests were 
not significant except for that of block 3^ ^whlch was ".3031 ^ 
while the expanded multiple regression/^ gain had correlations 



regressions^ gam 
of .6047 with block 3, ,3811 with blpfk 1, and .3422 with 
blook*4. However^ the correlations dff both of the gains 
with pretest and posttest 1 were conmr adic tory to the 
expectation that gain should have zeif^o correlation with a 
pretest. ^ The regression gain had- z^ro correlation wl th the 
pretest but both of the expanded mu'itiple regression gain 
and multiple regressiqn gain,^did nik have it. Indeed, it 
is mathematically impossible to^ e'k/^ect that a true gain ' 
vector t2^^^1 pretest vector wquld be orthogonal- 




IV. RELATIONSHIP. BETWEEN Pe/rFORMANGE AtJD ATTlrUM 



Five items in the first secjtlqn of .the attitude' 
questionnaire wer e re^g,pted ly * glVen to the students ('four 
times at the end of ^ihh bl/ook)./ The results of repeated 
measures analysis of variance ar^e given later. 
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respectively, but at -il i* and^ -s 03 with blockfl ^^^^^^^ 
Apparently,- th^re ifas a considerable amount- of systern fail-= 



' ^The itetn In ;sec tion ^11 &nd/the saopnd item in sebtion 
> III were rotated 'by fac;|6n' analysis .a^d' five ^ . 
extracted^ Tftese ^ five i^4ctors ;wer^ to relate stu- ' 

dents^ ^performance^, seizes toget^pr;^ith^ factors r 

' obtained' from Iterps T^through, 1% in section lIIV ltems:.t^ . 
3f;^f5r*6 apd 19f 20^ 21 In sect^ion hIII: were also^aused' i 
order to. relate wi th ; the peFformarioe aVore arid the' factors 
FI thro^ugh FVn, \ ■ ^ '\ ^ '^J'^ 

Seven factors^^ were correlated/ wtth 'the ^ficdr the / ^ . 

four blofik a^ams *and the time that student needed to com- 
plete a block. It "turned out that the, factors didr not ' 
edrrelate w4th| the time data / ' \ i,: V , 

Tfie rel ation be t^grf^tte b lo^^a TO mechanical fa j.l\jre 
Question 20 in Section Ill/Was- "How jDft#n :haa PIATO wo^ke^k 
'when you^have attempted to\use It?^*''^ The^ respon^eft^ ' . . 
correlated with timl'^ in blocks 1 'anid H at ^.25 and ^^.27^ 

■ ■ 

ureS during 'bldcks and 4^ ^and thud th^ . m|chani^al troubl^-^ 
affected students Mstudy tlrfie .. The ^ore olten P^ATp 
^enopuntered fnechanical trouble^ the mtire time stiK 
to, Spend tos c6mplete the instruc tion * Thti Interrupt: 
made studehts* learning less . ef f ic ieh t , The time In 
correlated with question 21 it 26i^ ^ Since this que: 
asked ''During your . school day ^ if you had youfi choic 
'much of your time would you spepd working wlth\^LAn- . 
time, needed^for obmple'ttHg bloc1< U hrd a'^ non-slgnlf icapt / 
reJ^atlonship with the motivation that was asked in fluestian 
21. , It is interesting to note, thatvfilme needed^ to. odmplete 
block 4^ correlated vlth questions M 9 j 20, and ^2^1 at^^.iSTj 
-.05, and -,26, TlmeVln Block 4. was affected b miohanical 
Interruptions but this did not make the studen' ^^ wint to ^ 
stop/using PLATO, HoWever, it did affect their wishes to., 
spend time working with PLATO In a negative direction. The 
summary of correlatp.on between time . in blocks and mechanical 
failure is. ^glyen in Tatfle 8/^ ^ ^ \ * . 

^ ■ ^ ^ . . ^Table 8 ^ ^ \ " ^ ^ "' V 

* Time" in ■ Blocks and Mechanlcal--'Fallu're 

Question alock.1 Brock2 : Block3 ■ Blockif 

■ 19' '"^ -.25* > -.14 ^ -.03 • -.27*' 
£0/ • -.,13 -.2d '-.10 -.05. 

'■ 21 ^ , -.. 11 : ■ ■ -.02 -. 10 . -.26* ■ 



,22, 



i 



' ■ The relation- betwe'en performance and meo'hanloal 
.fall ure i.. The most interesting question wnnVri ^hAfh^r!' or, 
^prot ■mec^anichi rnterryption affected students'' per f^ormftce. ' 
From- our study,, th'ere was no .indication of a •negative^ ■ 
effect. .- But" it should bte npfed that stud.ents'- learrining in' 
thts study., was controlled by,, a mastfry learning 'Itrategy. ■ ■ 
Hence studetits were forced to study until, they passed'the 
criterion-referentf&- tests .given at the end .of each' PLATO 
lessonV' '• ■ ■ , ■ ;, , . 

- " ■■■■ - V ' ■ . ' -^'^^ "4 ' ■ - 

V Cofrelatian of P-erformance" and Questions -1 9., aO-,-2'1 



.1^ • ^ — : ' ■ . , ..... 

rformance' anri Ois^.qhi nni^ -i g|^. gO-, 2^1 ' 

'^*.'Ques- - ■ Pre- Post-.^Post- ': - Block Block- Block Block 
, tion ,Gaj.n, teat testl testll Final ' 12 - 3 .4'. 

> 18 '.'it .20 .:bn .17 -.13 .15 .08 .15 ' 
20' :.,0;i7 ....05 ,18 .10 .16 . .22 .09 .20 llB 

;2i- o.cfe -.10 ,00 .01 -.07 .04 -.04 ^01 -.07 

^ [■■ • ' - ' ' ^ ^ ^ 

, The relation between att^itude^factors and mechani^ai 

failure . Students' at,titudes were affected hy mpnh.ahinii 
interruptions In a negative way. Both FI and FII corrtelated 
with 19 at .49, and with 20 at'-. 45, -.43 respectively. 
. F^actors FVI, FVII also correlated with 19 at .47, -32 and 
with 20 at -.42: an^ .39. Negatl've attitude factors Fill, 
FIV, 'FV--allenatidn, frustration or training stress, as' Fill , 
,a^ti-system,attitud'es as FIV; and impersonal PLATO' as FV— 
did not correlate wi.th I9, but Fill and FIV correlated with- 
20 at '.27 and ,.23. Frequent ocd'uranee of mechanical inter- 
ruptions made students less- favior^able toward PLATO and PLATO 

,, lessons, produced more frustration 4n learning, and made the 
students, ^complain more about impersonal learning. It was 

* Interesting to note' tlfat FI? correl-tated with 20 at .15 which 
i;s not sig^nif leant. > ^ltems; in FI'V were anti-system attitude 
in .:,a genferali way, % this jiist might imply that they -just did 
not like the system^ 'fr ' prior i . Therefore frequenc-y of mechani- 
cal interruption did|not. affect or ■stimulate their anti- 
system attitude. Nd'^raatter how well the system worked , or 
how frequently the system 'fail ed , this attitude must have 
always bfeen neg.ative toward PLATO. Question 2-1. correlated 
with all faqtors;;in the same direction as 19 did. The high 
rate of mechanical' interruption discouraged students' wishes 
to work with PLATO". ■ ' 



i, - 
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. The Corr.el|jti6n of the Attitucie Factors 



F'l ^ ^ FH" EflI;'FM FV " FVI, ; FVII 19 . 2|k.-v'.21 



19 

20 
2! 



.il9 ; ..ltO 17 -aiO. -. 17 .ii7^'-..-a2 1.00 -/2|.'XVM2 

^.^5 -.■^:3 =.2f , .1^, .23 _,ija..i.39 29' t, 00m--;"2^1 

-,-3|J . 2f ' - . it 7 .'70 ■ - . 52 . 42 - ,;B1 1 .-00 

Ttie rerata'on 'be'tifeerfV attltude:? arid aoh'l eviemgnt . 



Co F r el a tl dji al • . an al y s i,s 
reveal&d^^tt^at ^FlI,;. FUJI 



or^ factors^ and 
and FVI were 



performance scores' 
'd lid rim in a tors of 



" K Table Tl 

/,,The Corralition of the , Attitude Factors 
^/ / ■ \ with Achievement 









test 


FI 




Fir 


,24* 


Fill 




FIV 






-.'05 


FVI 


.10 


FVII 


-^.11 



.16/ 

23 ■ 
-,1.2^ 



Final 
grade 

.28* 
-.37 

-.03 

.27 
-.19 



Reg 
gain' 

.«ll 

. 19 
-.20 

-. 02 . 
-. 15 ■ 
.21 C 
-. 08 - 



Mul t , 
- gain 

J: 

'.37^ 
'-.01 
-.1:6^ 
-.'23^ 
-•12 



'p<.05 



The- correlations of factor: FI with perforrriance'", scores 
were not' significant. Personal involvement with PLATO and- i 
favorable attitude^ toward PLATO did not. relate wfctft academicl 
performahce measured by a special- topiG=al test, final grade, 
and gain scores. Table 11 does"not include ;the correlations 
of FI with block exams and posttest 11, but they were all non- 
significant. Factor Fiv represented the anti-system ' 
attitude--complalning that answering to responses became 
monotonous , the CAl approach was inflexible, and mechan ic-al ' 
malfunctions ericountered while on PLATO'^ — and did not cor- 
relate with performances ., Attitudes toward a teaching 
medium--whatever it wa5--were Independent from achievement 
of learning, and those attitudes must have been planted ' 
before the program started. Pretest did not correlate with 
FI, FIV, and FV, Factors. FiV and FV s tayed at zero correla- 
tion level as the program wept/by, while correlation of FI 



increased according .to an order of tests given from earlier 
to later* ^ However , thesfe values were no t ^ statistically 
^significant; Hence no conclusiohs should be from Table 11. 

' _ Factor FV, impersonal TLATO, did not correlate with 
performance scores , Iterns In FV represented the weakness of 
instruetlons that, had been attributed to CAI in general, 
'using a machine to teach .and interact with students. "Nobody 
really oared whether, a student learned the course material 
or not"; "I was not concerned when . I missed question ^ 
because nobody was watching 'he"7- "I felt isoltted find^ " 
alone"; "I was not aware of >f forts to suit the material 
speoifiQally tp me Md^ I thought the course material was 
presented) 1:oo'' slowlyvn Students were more Invalved in 
operating the terminal than In understanding "the course' ' 
material and hence the equlpment^ made it difficult- to - 
concentrate on the course material/ The question of to what ■ 
extent mastery learning techniques played a role-pf re'ducing 
the effect of FV on the students' achievements was not 
clearly answered from our data. 

\ ■ ^ ^ . 

Table 12 ■ ' . 



The Correlations of Attitudinal Data and Fl, IV., and V 





Pre- 










Post- 




test 


M 


M 


B3 


li 


test 1 


FI 


.04 


.08 


.09 


. 12 


.18 


' . 18 


FIV 


.03 


-.07 


.01 


02 


-.05 


-. 00 


FV 


-.06 


-.04 


-.02 


, - . 08 


-.09 


. 16 



FII was originally clustered together with FI in the 
first analysi s we^ conducted , The correlation of FI + FII, 
items in FI and FII together, and FI and FII separately are 
presented in Table 13. . * 



Ta>le 13 



The 


Comparison 


of FI, FII., and FI+FII 






Pr e- 

• te St 


,Post- 
testl 


Final ' Reg. 
. grade . gain 


Mult. 

gain 




FI .04 
FII .24** 
fl + 
FII 


-.29 
.23 


.20^ ' .18 
■ .28 .19 

.24** .20 


.32 
.22 




**p<.05 
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' FII was significantly correlated with all performanoe 
scores except for regression gain, but FI + FII were not sig 
. nificant except for the final grade. FII was perception -of 
effectiveness of PLATO lessons; the students felt they oould 
work at their own pace and thought that material which was 
otherwise boring could ■ be in teresting when presented by ^ 
PLATG, Moreover, they thought CAI made It possible.^for therri 
to learn quickly and did their best work with PLATO, lessens, 
They;^elieved that PLATO lessons were npt dull and not dif- 
ficult; to^ follow. PLATO as used - in this oourse was an - 
efficient use of the student's time and' responses to, their 
answer se|med appropriate. It .was in tf resting' *to note that 
Fll^CjSjrrelated with , the performance' scores but FI did not. 

Fill was also a ^IscrinTlnator of per formanoe scores, , 
_ This factoid expressed .frustration and stress in learning 
PLATO lessons. The factor represented "alienation , " i.fe. 
feeling little involvement with learningi and seeing PLATO 
only as a task necessary to. complete the program* Items 
included "PLATO instruction is just another step toward 
depersonaliv^^d inatructlon"; "Too much material was 
presented, so I felt pushed"; "1 was uncertain as to my 
performance relative to th^ performance of others." "I 
could not fiollow the questions I have been asked and I "felt 
some questions were not related to the material presented"; 
hence, "I guessed at the answers to some^ questions . " 
Students felt "Tense and frustrated by the situation." They 
were Qoncerned that they "might not be understanding the 
material^' and "just tried to get through the material ' ' ^ 
Vather than trying to learn." FII oorrelated positively and 
Fill correlated negatively with all performance scores 
eonsl stentl y , - * 

FVl correlated with soma performance scores , posttest I, 
final grade and multiple gain scores but their magnitudes 
were smaller than those of ^ FII and Fill. FVI represented 
a positive feeling toward PLATO teaching • For example, 
"Working with the PLttTO system, was challenging, ma'de 
me proud of myself, /was fun, exciting and enjoyable." 

FVII represented the negative feeling toward PLATO 
teaching--that working with the ^PLATO system was annoying, 
frustrating and confusing , But F.VIl' did not correlate wi th 
any one of the performance scores. 

The relatlpn of Pos'fetest II with attitude fa btors and 
time in blocks , Posttest II was given at the training 
course. The test consisted of the same items as the pretest , 
and posttest'I that was given at the end of the PLA'^" program 
but orders of items were randomly changed. The tlmfc needed 
for completing each block did not correlate with either 
pretest or posttest 1, but the tlrne spent in blocks 3 and ^-1 
correlated with posttest II at -Al and -.32 respectively. 
The'scores of posttest II correlated with posttest I5 final. 
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The scores of posttesbll correLated with posttesti, final-. 
B1 B2, B3, and B4 it .482^ .440*, .292*, .365% ^25% and ' . 
.211 respectively ( p<.01). These results implied, that time 
spent in the last two blocRs had more effect oh the perform- 
ance of posttestll, that wa's givertN eight weeks after , the 
PLATO program was over, than' achievement scores' of blocks 3 ■ 
and 4 tests. It probabte was related to a reten tlon-of-" • 

■ learning effect.- , " . - " , ; 

The relation to atti tude factors was checked, and only' ' 
FIJI had a significant correlation with posttest II gf -..■302. 
The correlation of Fll .dropped/to ^ 202 .whioh'.was n ■ 
significant anymore. It indicated that Flll'^was also a 
' d Iscriminator of" future performance," 

V.' SHORT FORM ATTITUDE QUESTIONNAIRE 

, ' Patrick Maritz" ' . 

Parallel, five-ittm attitude questionnaires were 
repeatedlV administered . to -the . three trainee groups. at the 
end of each block 'of lessons. The questionnaire was designed 
to measure a.tti tutfes towards the trainees' respective forms of 
instruction. Thus, the short. form attitude questidnnalre 
was able to measure the amount and direotion of change of 
trainees' attl.tudes towards their curriculum during the four 
instructional periods. - . ■ . ■ 

-SlnGe the trainees had recently arrived at their ^ 
^training school and were about to embaf^k upon their special- 
ized fields of .railitary interest. It Would be expected that 
trainee attitudes would initially be highly positive toward 
their training' drrespeotlve of the form of their training. 
As the trainees axperlence frustrations enGouritered during 
the training y the average group attitudes toward their 
training would decline. The attitude decline would become ' ^ 
leas from period to period as the trainees began to cope 
with the frustrations. With the forms of frustration during 
training being .different for each of , the groups and attitude 
parameters largely being a. function of the effects of 
instructional frustration, it would.be expected that the 
groups would have different Iriitial attitudes and different 
rates of attitude change. Type one training was a pure 

■ computer^assi'sted instruction ( CAI ) curriculum * Type three 
was a programmed text instruction presentation. Several 
ratios of the twO; previous types make up the second 
curriculum form. All the", cur ricula were measured with 
parallel at tl tude questibrrn.alres concerned with the same 

^,aspects of curriculum. The aspects consider ed were 
enjoyment of the time spent in instruction, percelve*d 
aehievement of curriculum goals, desire to continue with, 
instructional form, general sense of accompl ishmerit derived ^\ 
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froni the curriculum, and whe^bher the curriculum i/a's ■ 
challenging, / ^ ' ; 

■ ' ' , ' ■ - : . . ■• ; ■■ . 

and^ resulfc^ ^ A completely' crossed 3x4x5 
f .a c; to rrWl~ in a 1 y s i s 6 f : v i r i a n was perfprmed upotf the corres 
pQridlng ■ f'Sief.tors; instr uc tlortal format^ blocks of time, and 
questlgnha^ire itetns CGncerned with attitudes toward curriGU- 
lum-^^^^ .Tftr ^students w.ere. nested wii^|iln the ihsfcruotloii 
"formaV arid cr^ossed . with blocks arid 'items . A significance " ' 
level of ^^*05 was utilized. For the main/ effec^^ all of- 
the F--ratlos were slgnlfiaant^* All^of the two-way Interao- . 
tlons were also slgnlflcaht. The three-way In teradtion was 
not . algniftcant , . ; . / - , 

A sferies. of post-hod pair-wise mean aontrasts. were 
perfornied using/ the' Sheff* test .at a ..signif rcanc e level of 

*05- \The She'ff # te^st was^ used 'du6 to unequal cell sizes. 
Pair-wist qontV^ast for 'instructlbnal formats showed that the 
signif iGantlf'^dlf ferent pair of means was. the mixed form 
ana the progS^ammed text form.* For blocks of tirne, all of ^ ' 
the pa'ir-vflse^dif ferences among the four blocka were signi- 
ficant <With the expeption of the blocks two- three contrast. 
The items dealing with the student's attitudes toward ourrlo 
\ulum had no differences among any pair of means. 

: ■ . ' W ' . ^ ■ ' ' 

, Complex contrasts for the i|ain effect of Instructional 
form showed p signlfloant ^^differenoe between the mixed 
groupVs mean and the fitfmposite mean of the CAI grdup and the 
progranied text group . ^ Slmll'arTy ^ when the programed teict 
group was obntrasted against the composed mean of the other 

^ two groups, th$ difference was again significant . Since the^ 
only non-significant pain-wise difference for blpoks.of time 

, was between blocktf'^tiwo and three ^ the only cdmplex contrast . 
'performed was to ..look at the first half of^ the time against 
t^he seeond half j i.e, blocks one and two against three and 
four. ,rhe blocks compl ex contrast was sigrilficant* When 
the greatest pair-wise ; difference among the items of currio- 
ulum was not at the. significant level, it was indicated 
that the signlfiaant ANOVA' F-ratlo for the item main effect 

,^as refleotirig a complex contrast. Therefore, a Qomplex [ . 
contrast between the highest mean arid the two slowest meaWs ^ 

'was performe.d ancJ- found significant thus confirming the / 
K^ratio... ^ . ' ^ ' ^ \ ^ ■ " " ' -'J 

The Vesults show that initial attitudes toward in^struG- 
tion among the^ groups were different after the flr&t* block 
of lessons. The NP groups were confrohted with the conven- 
,tional instructional frustrations of lectures, such as - 
failure to hear or comprehend portions of the lecture/ not 
keing able to immediately, repeat difficult points, peer dis- 
traction, etc. New frustrations of machine down tilne, 
improperly working programs , ambiguous s.tatemen ts , etc.,' 
were the probltms of the PB groups* TheSPB groups may have 



-28 



had as many frustrations as the NP groups but the problems 
were new to the pB group* ^ As conipared to the/ f amil ar s prdb- 
lems with which the NP group coped , the' new PB prqblems 
would initially have a lesser atti tude; depression effect . 
The. CP group's frustrations were .partiaHy alleviated by 
having their routines broken up by having diff vent • instruc- 
tional settings. One type of frustration, boredom, was ■ " 
alleviated.' Thug i the groups .are in Itlally order ed 

V The next question is whether the groupVs attitudes 
differentially declined during the periods. With the exoep-^s 
tion of the NP group after the ,thlrd period of instruction, 
t,he groups displayed, a smooth negative exponential decline 
in attitudes even though renjalnlng favorable* Being con- 
fronted with fafniHar frustrations induces, the NP ftroup ' s 
attitudes to deoline at the greatest rate. Being preset ted 
with new roles in a CAl envlronrnent mitigates Instruq tional 
frustrations in the PB groups generating the .most stabM 
attitudes even though not the highest. By combifiihg the^"^ 
previous two methods^ the CP group *s^attitudes decline at a 
rate between the other two types while maintaining consls- 
tantly more favorable attitudes than the previous two 
groups. The groups did not significantly interact with the . 
questionnaire items nor the Itenis with the blocks of / 
instruction. Thus, the differences attributable to, the /"^^ 
groups are mainly a function of attitude differences,^^^ \ 

Conclusion, DifferenQe- among the groups ar>/malnly 
attriluSTble to a.ttitude dif f erferitials . . CP p^€uces condls^' 
tently more favorable attitudes.. PB attitUres are the most 
stable. Depending on how mmh weight Is^to be attributed to / 
degree of f avor,abili ty and degree of>-r€abllity bf . attitude , 
^the percent of instructional tlnie^.-^'"n PLATp oould be ^ * 
4;etermined, A more ex tensive irrvestigatlon of the /percent 
of time spent on PLATO woul^d-^elp ,to determine the 
Interaction between attittfSe favorablllty and stability^ - 

^VI. ^^UMMARY AND DISCUSSION / 
* Klkumi Tatsuoka / ^ _ 



^Factor analysis was performed on the 66-ifcem. atti tude 
qy^tionnal|*e and seven factors-were extracted. They are 
.Summarized as follows: ^ : ' 

I. Personal involvement wi th 'PLATQ, or icceptabillty . ' 

II. : PerQeptlon of effectiveness of PliATO. 

III. Alienation - PLATO as a task, not' learning . ./ 
IV • An tl ^system, " - ' " r 

V:. Impersonal PLATO, ^ ' ■ / ' / — 

VI. Positive feeling toward PLATO** . * ' 

VII. Negative feeling toward PLATQ* 
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/ ' Positlv'e^^rcepfcion' ^of ef f ectl veriess inf PLATO lessons 
was;associ€Md\_wlth better aohievenien t , and frustration and 
;stress ot/learning led t^ lfess favorable aohlevemen^t 
fesults.^^ It probably could be .G^nclud that the lessons on 
the Rb^ATG sy^ needed to Implement mo.re help branches, and 
moij^ individualized fee on the questions*; The leng.th. 

each, lesson must be esrefully; planned so> that 
'presentation of ^too much 'rhater lal at a time can be avoided/ 
It wss apparent that wm.e studerrts could take, long lessons 
thatVmigHt cdntinue for more^han one hour or two,- but other 
■students felt pushedfand that they were presented with too 
much mater ial*- ^enclj they needed more time to complete 
^ the Ir assignment , ^ ^ . " 

It was Interesting to note that regression gai.n did not' 
cprrelate wlth^ any attitude factors, while multiple'- regres- 
sion gain/and pre- and posttest I correlated with some ■ 
faqtors. Although the reliablli ty of regression^ gain scores 
was loWj pre- and posttest 1 suffered from low reliabilities 
too. Moreover, the multiple regression gain oorrelated with 
three Block tests, 1j 3^ and 4, at \moderately high correla- 
' tion valueSj but the regression gain correlated only with 

, block 3 test at *30, which/is barely Significant, Final 
grade and posttest II showed larger correlation^ values tith 
the m.ulttple regression gain than with the regresslori giift, 

'This fact implied that the traditionally, used regressl^ ■ " 
gain mepsured ^ something differen't from all other tes^rt?^ 
Therefore, there was a serious doubt about u^ing re|ression 
gain (residual gain) to measure the difference between a 
posttest and a prete^st, ^/ 

The gaitt: scores measured by multiple regre*ssion with 
some block tests were; alfp affected by attitude factors FII, 
Fill, and/FVl. _Morfe pbsi ti ve^ atti, tutfe:^ , as measured by FII 
and FVi , was^ assQciated ■with a b'etter gain, while more 
negativiB attitude, as measured by Fill,, went along with less 
;galn in performance. It should be noted that the achieve- . 
ment was not affected by rnechanlcal failure or system 
failure., counter to the instructors' negative eKpeotation, 
^ but students* attitudes' were affected, significantly nega- ' ' 
tlvely. The Interpretation of the result ma^ be attributed 
to the ^mastery learning strategy which the CJiftnute' ^FB CBE 
project adopted in their prog ram ^ and students were forced - 
to study until they^ passed the criterion-referenced tests ^ ' 
given at the end of each PLATO lesson, ^ 

" ■ . \ • *^ " ■ ■ ^ " 

The time spent in the last two blocks had^ more effect- 
on the performancS of posttest II, which was given eight 
weeks after the .PLATO program was over ^- than the achievement 
scores on Blofik testS'3'and 4 had.- This i s partlcularlSr ^ — 
iri terestlngVbecause the retention^ may depend more on hdw : 
much time i student spent on a given topic until he/she ; 
masters iy^ and less on how well he/she did on the test. 
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The. arialsrsis W the . form afctl Aude ^UiS ficniiaire i 

rapeitedly/ given four tknes at the end ofl^BlocIc tfsts " 1 
revealed tttafc both PLAl^ Coriibl*.ed PLilTO groiips .1 

; - toward: the ^pr^gMm^ ^ but the attitude of Hori-pLA Ttf^ gTc^np - ^ , . \ 
^/^/^ .^-flua tuatfed 'according Irisfcruot^or^' popularity--/ " ' i/ 
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• : ■ . - ■ : =...; . -^^ BLOCK if 

Circle the . numbor p fe«l about .the following 

statements. , '. ■ • : " 



Very -Very 
Strongly Stpottgly 
Disag ree-^ - l„:Jgtt£ 



1. I enjoyed the time I spent on PLATO. 



2. 1 leaF-ned what Jhe PLATO lessons tried ' h3 1 3 5 6 7 8 9 
to teac h . ' ■ ■ , • .: -' - . • . — 

3. I would- like to study more PLATO 0 1 2 3 U 5 6 ,7 ,8 9 
" les sons . 

M. 1 feel PLATO aidn't teach me very much. , 0 1 2 3> 5 6 7 8-9 

5., I fjeel challenged to do my best work on 0 12 3 i| 5 6 7 8 9 

PLATO. . . ^ -..i., ^ ' ' ' 



6. Wliat have you erijoyedV^st. about using ' ^9<I 2 3 4 5 S 7 8 9 
• PLATO?; (You may us.e the other side.) ' ■ 




If. you could change anything about PLAtS^what would you Qhan'ge? 
( You may use the other side) . 
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PliAro' .QlTESriONWAIRE 



; < 



Very Very 
■ ■ Strongly Strongly 

. • \ Disagree ktrme - 

1. T!i 6 method by which"! was told; whether ■ 0 1 2 3- 4 5 6 7 8 9 

I had give ay^nj.jght or wrong answer . ■ ^ • » ■ 

. .. beeame rnoriotdnous , , " ', 

Z. Wob'ody' really* cared v/hether I had . 0 12 3^ 5 6 7 8 9 

learned the QQurae material' or riot. ' ^ ^ 

3. I felt challenged to do my bast work* 0 1 2 3 4 5^ 6 7 8 9 

4* I felt Isolated and. a lone, 0 1 2 3 4 5- 0 7 a 9 

_ 5* I'felt as if 5omeon&. were eagaged ln 0 1 2 3 4 5 6 7 .8 9 

/ eo^veraation with me. ^ = - ' : ^ 

6. As^ a result of having studied by this' 0 1 2 3 4 5 6 7 8 9 
method, I am int-eristed in learning ^ ^ ^ 

^ more abbut the subject matter, _ ' — 

7. 1 was more Involved iri operating the' 0 1 2 3 4- 5 6 7 8 9 
tennlnal than in underhand Ing the ■ • 

course miterial. 

8. The learning was too mechanical. • 0 1 2 3 4 5 5 7 8 9' 

5. L,feit as if 1 had. a private tutor. 0 12 3 4 5 6 7 8 9 

10. The equipment macie it dif ficult to - , 0 1- 2 3 i) 5 6 7 8 9 
concentrate on the «ourse material . ' - 

.1^ The situation maae ^rae quite tense. ■0 1 2 3 4 5 6 7 8 9 

.im^ PLATO as used in this course , 'is an 0 1 2 3 4 5 6 7 8 9 

i.l inefficient use of the student's time. 

1 3, ■ My ' feeling toward the course niaterial ■0 1 2 3 4 5 6 7 3 9. 

after .1" had had cornpleted the PLATO ' - , . ■ 

.portion of the oQurse was favorable. , ► 

14. I felt frustrated by the situation. 0 1 2 3^4 5 6 7 8 9- 

15, t found the computer- assi sted .- 0 1 2 3 4 5 6 7. '8 9 
• instruction approaoh in in this course ' : ,- ■ 

■. to be Inflexible. • . ■ . . . 

16. Material which Is otheri/ise Interesting 0 1 2 3 4 ■ 5 6 7 8 9 
can be boring, when - press nted on PLATO. ^ . . 
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' . ' ■■' Very ■ , Very 

■ . -Strongly ' Str-ongly- 

17.. I was satls-fied wltJi wliat J learned ."'".O. 1*,2' 3 4 '5 S 8 9 

■ ■ ;wlille fraklnii the crfurse . ; ^* . " , " ' ' ■ 



18. Iti view of the amount I 

method seeins superiQr to. classroom 
ins true tlofi for *many Gourses. 



learned, ^thls 0 1 g: 3 5 5 7 8 '9: 

. qX assroom ; ' . ? 

rse 5 . \ ^ ' . - _ , 

traditi.onal ' ^ Q 1 "$.14^J"6 7 3 9 



19. I would prefer; PLATO to 
instruction . ■ . 

^ / ■ 

SO. PLATO instructlori is just ariothepL.st©p^ 0 1 5 3 4 5 6, 7. 3 9 
; toward de- personal i zed instruction. 

21. 1 w^s ccneerned that I r^ight not be ^. 0 1 a j 4 5 5^7 8 9 
underste^4ng the . material . \ / . 



22. The responses to my answers seemed-- \. 0" 1 2 3 4. 5 6 7 3 9 
appropriate, . - ^" " ' " 

23. I felt uhc^rtaln as to^. my perforraanGe ^ 0 .1 234 5 i .7 8 9 

iri the programmed course relative to 
the performanee of otliers, y 



r 



2^, I was not cbneerried v/hen I missed a , 0 1 2 3 4 5 6 ^8 9 
. ' question because nobody was Vatchlng'^me, 

- -. ■ ■ . ' ■ ' . • - - ^ ' 

25.. I found myself Just trying to 0^ 1 2 3 4^ 5 6 7 8 9' 

through thp material rather tharr^^ ■ " :, 
-trying to. Ifearn, ' ^ % \ * ; ^ / . ^ \ 

26, I 'kriew v^/hether my answer'was ri[jht*dr 0 1 2 3 " ^ 5 6 7 -8' 9 

" wrong Before I v/as told, . . ' ' ^ ^ '•: -. 

27. In^ situation v/here^I am trying to- ' d 12 i M 5 6 7 -8 V 
learn soinethlng.j it is Important to rhe 

to know where 1 atand' relafcl1/e^ to ; ' ^ ^ - ■ 

^ othe r 5 . . = . ^ ^ ^ ' ^ ■ / ' 

2'8, I guessed at the -answers to. soma ^ ' 1 2 i M 5 6 7 8^9 

questions* ^ . \ . ^ " ^ 

29. i was aware of efforts to sfflt the 0 1 2 3 ^4 5 6. 7 S 9 

= ^ . matarial' specif leal ly to me, ^ ^ ' ' ' ..^ ^ v / - 

^. 30- I was encouraged by the res.ponses given a 12 3_4 5 6 7 8 9 
, ' ' to iHy answers of questions, * / ^ _ " ' 

, ' 31' In view or the time allowed for 0,1 a* 3 ,4^5 5 7 9. ' 



learnlnij I felt tpo much'mater ial was 
pre seated . - w . * \ ^ 
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Very, , Very 
Strongly; Strongly 

Bisagpee j ^Agf;^ 



.32. l^entei^ed wKbrig gr^swers in order to- get 0 ;1 2 3 M, 5 5' f s 9: 

mo^■6 information f'pora the maohln . ,' ■ ,,. ' 

33. I felt I could work at my own pace. 0 1 2 3 4 5. 5 7 8 9 

34» Qu_^3tions were^ isked which felt wferfe . 0 1 2 3 4 5 6 7 8 '9 
nob relaed to^ the . materials presented- ' 

. ■ ' , . =^ . . = ■ ^ ' . 

35. Materdal.. which Is otherwise boring Qan 0 12 3 4 .5 6 7^8 9 
_ be Interesting when presented by PLATO, . ^ 

36. jVoouia liave learned 'more^if I hatfn't 0 2:3 4 g 5 7 8 9' 

' ^^©It pusned% ^ : \ ■ / ; ; ' 

37- l.wps riven answers but/- still did. not 0 1 2 3 4 5 5 7 8 ' 9 
. understarJd tfie questioas.^^ - \ 

\ ' r ' ■ ' ■ ' ^ ' '^ ' ' ' ' " ^ " ■ 

38, The course material was presented too 0 12 3 4 5 S Y 8 9 

slowiyi ^ ' \. : ' ' ■ ^ ^ ' 

^^'^■■^ . • ~- . ■ •-- . ■ 

39 • The responses td ^my-^^ahswers seemed to 0 1 2 3 4 5 6 7 8 9 
^ take Irtto/a^coDunt: the -dlf 



40. Uhilm or} H.^ro, I encountered machanlQal 1 ^2 3 4 S 6 7 6$^ 

. ' ^^ ... .'^ ^ - , * - ■ ■ \ 

. Computariai'slsted ^instruot^^^ 1 2 3 4567 8 9 

make it possible, ft r^nfe^to-^vie arh quickly. . ' . 
, ■ - ' ' ' ' ; * ' — ^ ^ ^ ^ \ ' . ^ ' ' • ' . • 

4 2/^ PLATO Goul'd bt mwGti bet;ter;lf the 0 1.2 3 4 5 6 7 8 9 

l^s^ons wer% iftRroved; / ^ - 

■ . . ■■ * ' _ ^ - . ■. " - : 

43, The lessons^ oJV RLATO were interesting 0 1^ 2 3 4 S 6 7-8^9 

arid really l^^pt ma Involved^. ' ' 

4^.. ^What J l^arntdfcf rom" PDAtTO msdA ^bhe ^; 0 1 2 3 4 5 6 7 8 9 

^■^Gla^srooni a^J^;.^^:i^aboratory in , . ' \ ^ 

easier- to ^uad^l^^tan /-^ - \ -\ \ J' , ' 

45, ^fhf PLAtO les^aoki ^were dull 'and ■ ■ 0 1 2 3 4 5 S 7 #ij 

- dif fla^ult^tD fo»w. ■ ' ... -.-L ^ ^ ' ^ " 



;.' PLA-f 0' QUESTIONNAIRE , 

. . SECTION Ztl 



• . \ _ Very . ; : Very 

Strongly ; Strongly 

^ \ ^ Pi-sag ree . V Agree 

i\s a student 1 do rny bes-t work with ' • ' . ; 

K^Mov.ies and filiristrips. 0 -1 2 3- 4 5 6 7' '8, p 

2. PLATp lesions. - ^ . ^ 0 12 3 4 5 6 ?' 8 9 

^ - ^ ' • - - ■' • 

3-. V Study guides and workbooKs . 0 1 2 3 4 5/6 7 8 9 

' ; 4. Instructar lesypris, r. ; ; 0 1 2 3 4 5 6 7 8 9 

^5. Laboratorj^ instructions * \ v 0 ^1 2 3 4 5 6 7- 8 ,9 

6. Programmed, texts, ■ V 0 1'2 '3 4: 5 6 t 9 
Working with the PLATO systemf ; 

7 . Is fun . ! '■ . ■ ^ " • 0 1" 2 3 '4 5 6 7 8 9 

8. /is frustrating. ' " ' • 0 1 2 3 ^ 5 b' J 9 

9. Is chillenling. • ■ , o'l 2.3 4 5 6 7 8 9 

<' . .- . -. 

1,0... Is annoying.'* 0 1 2 3; 4 5 6 7 8 9 

111 Is confusing. 0 1 23 45 67 89 

12. Makes me proud "ST niyself. oil 3 4 5 6 7 8 9 

13. -Is boring. , ? 0 1 .2 3^ 4 5 6 7 8 9 
Is relaxing. . - 0 1 2 '3 4 5 ■ 6 7 8 9 

15. Is depressing. 01 2 3 4 5 6 7 0 9 

-16. Is -enjoyable., . ' 0 I, 2 3 4 5 6 .7 8 9 

17. Is de-persa^nallzing. ' 0 1 2 3 ;4 5 6 7 ,S 9 

18. Is exiting.- ■ : O ' 1,2 '5 5 6 7 8 9 



10% 10.0Z 
Of The Of The 

Time ■ Time 

.1?).. H6W' ofteh has' PLATO worked when you 0 .1 2 3 J/5 6 7 8 -9 

have attempted; to use -it?. . 

20* During how many s,esslons have the ^ 0 1 2 3 A.5 6 7 8 9 
.echanloal Interruptidns'raade yau want 

to stop using PLATO? ' V / , ' - 

■= ■ ■ ^ . - • . '.. ■ ' , " = ■ . ' 

2U During your sphqol. diy,.Lf you hafl yo\4r 0 1 2 5.6 7 8 9 
choicej how mubri of your time would be • 
' spent working with -PLATO? ' . = 
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- , - . INTRODUCTION . „ ■ . 

' Badkground ■ ; / : - - v 

■ ' - . . ■ ' ■ / ■ , _ . ■ ■ 

■ An Important . aspect of the Implementation of ■ computer- 

bas^d education CCBE) is the •attitude of instructprs. This 
report examines the attitudes of instructors at fihanute AFB 
a site with SO- PLATO IV terminals, thesejattitudes were 
shaped by the Instructors' experienoe while observing? • 
students as they proceeded through their CBE lessons "br 
while working at PLATO terminals ('i.e.,'"on-line") them- 
selves. The significant impact of the instruotor attitudes 
on the pedagogloal, effectiveness of ^ the lessons is noted 
(see section on "Attitudes of Others"). • - 

. ■ ■ - ■ 'f, - ■ i' . "■ ■ ' , ■ 

The^e attitudes were m|asured in several ways. MTC 
staff interviewe.d the instructors individually and in a . 
group, :an;Thl& lny,estig.ator administered to the instructors 'a 
questiohnaire regarding the specif Ic lessons ' arid an on-line 
, survey (Avner, 1976a) on attitudes In general . In addition 
separate reports on student attitudes in the Vehicle train- 
ings course have been prepared by .Dallman , :DeLeo-j Main , ajid ' 
Gillman (1977), and by Tatsuoka, Misselt , and Maritz (19^8). 

Relevant Factors • " 

Several factors contributed to the formation of anstruc 
tor attitudes: 

l.^thfl ease with which the termlnai' keyset could be 
" / use|^.Cne., design/use characteristic 

the reliability of the system during the time when 
the students were scheduled to work-; 

' 3- the quality of the lesson materials being used j 

■4. the attitudes of fellow instructors, and less 
directly, other Individuals who influenced the 
students' feelings toward the systern; . 

5. the quantitative and quilitative benefits the 

students perceived from Vthe, time and effort Invested 
in study of the lessons. \ ■ . 

Each of these factors is considered in the formulation of a 
aomprehensive' estimate of Instructor attitudes. 

_gx press ion of Attitudes , . 

Students and' instruGtors indicated their oprnlons In 
various waysi 



1, ^orally to^aoh other on to the staff during or- 
after^ a session; in a particular less 

2* in written. \form^ either on paper (t.^ 

or in various. Gomment Flies walritatned on the PLATO 
. ' : system; ... / ^ / 

3,. in a non^verpar J^shion by^^^t^^ 

when observers from CERt were pre (i.e^.^-'B^^ ^ 

student spending, an 'texcesslve amount of-tline on 
. . ;: . certain frames>/the; instru'S tors, could, it they were- 
so vlnclined^_then^ act on this situation by calling:^ ^ 
thf $e. frame;s *to the attentiori of the authors. 

The attitudes of the teaching ; and support staff , coupled 
with those of the- stud.ents, helped to give^ a comprehensive ' 
^rspective of the total 'learning environment, " J ' 

Iiy ; SPECIFIC FACTORS \AFFECTING ATTITUDES; . 

InfceraQtl on with the Keyset and TermlnaT 

It . was the^ qohsldered opinion of the Instructor staff 
that students had little trouble worklrig- with the keyset at 
the PLATO terminal. This was the case even though the.; v : 
students taking the special purpoM vehicle and geherai v - 
/purpose vehicle bourses had a technical , »^hanys-on** " - ' 
:ar;if ntatlon to- vs(ork,= As one former lnstru:qt0r put^it, these 
students wouldrather "have a Wrench In their hands ^"v v ^ 
instead of a keyset, - ;^ - ^ / - - : 

^. -^The instructor staff members were conscientious and 
apncerned with the; needs . of stuflents interacting with PLATOt^ 
As an example, when some of the students complained that the 
:semi-darkness ln:the PLATO clas&room (to control glare on 
terminal screens^ from overhead lleht Ing ) msde note-baking 
difficulty a small hlgh-intensjt wis installed npar 

each terminal . In., addition , most of the questions within < 
the lessons were multiple choice, one word, or short answer 
in format .. ^This facil itated the interaction with the term- 
inal by rediicing the amount of typing required . These 
concerns for human factors tended to eliminate .any dlffi- \ 
culty with the use of the keyset. ' . ^ - 

^Reliability of System ^ V ; - 

In the first few years of PLATO system operation,, there 
was considerable concern over tKe rel lability of continuous 
service. That there were ma Jor- problems at that tCme cannot 
be denied. However, the quantity and duration of ^ 
interruptions have been steadily reduced by system changes 
and Improvements, both invSbftware and hardware technolbgy. 




■ In. addition, ^areful^recArds.hav .kept slnde ig?^*' ^ .■ " 
listing Interruptions of .sarvice-toing prime i'time usage , '. 
peripds- as well, 'as -reSso interruptions- (Avnep , ; ' v ' 

■'1974). Statistics on reliability^ave also been documented - ' ' 

in the AFfRA annual and semi-annual- reports Ci*e., CERL, ' . 

, 1975> 1976) Nevertheless , the -general increase iri ' trouble- / / " 
' free/ operating time is of little comfort to the student- who- - T' 

■ expef'iences a crash ln:,;the middle of a lesson. ' 

When- there is an interruption of .systeni operation , the 
•Chanute instructors wait to see if^ service will' resume ■ • 
momentarily. The. PLATO sys%m Staff members are spmetitnes . 
. queried by telephone regarding the expected time of 
resumption of -service. If it is apparent that service will r 
not be restored shortly, the Instructors take the students ■ 
to different orassroom and' prodeed to teach (via tradl- ' 
tlonal lecture and discussion methods) the materials that 
^ would have been -covered in the "^LATO/materials h^ 'there ' ' ' 
• been ho interruption. /There is the chance that thW^ instrue- ^ - ■ ■ 
tors might not^ feel prepared to take 6 on a > 

moment's nctlce, and thus they are very cohoerned about the 
probability of resumption of service. In; addition; there 
.appears to be /little enthusiasm for these impromptu lectures . 
among the Instructor staff even thaugh somenriiay; have been , ' f^.' 
.critical of PLATG system operation in general. ' \ : 

' Syatfrt Interruptions oecur for a variety of reasons as. 
a result. of software ^ and hardware problems* During^ : . 

scheduled weekday periods, there Isv^usually no advance 
■■ warning before an interruption or "fenash" ocQura, However, 
authors can Insert special commands 'at . appropriate p / 
their lessons so that| 0n6e the system is worklrig^^^^ a / / - 

student cah continue on from approximately the point he or 
she ha^d reached before the Interruption to service. This . 
'^restart" feature also allows students to leave the, terminal 
either for a break or at the end of :the day and automatlaally . 
return at a later session to where they had left.off. ' 

^ Observations made at Chanute show that-thfese prbcautions;^ 
were not always taken 'by the authors of the ^CBES|t^ter;la^^ , 
and even /when Impremented^ the exlsWnce br; use"'a# the 
restart points was^ apparently not understood by lns;truc'tors. \ ^ 
They were observed /informing the students that they iftbuld ^^ 
leave their .records "slgned^ih!V,whil# the students left the 
ro,oni to^ take b short break^v : The" 'reason given was that this 
procedure would keep the'lA place so that the students -would 
not, have .to, repeat^a larie portion of the lesson when they 
reaurned work. This caution on the part of the Instructors 
indicates^ that either there, were some lessons with / ^ v 
inadequate numbers of -restart^ points or that the r / ^ % % 
instructors had not been fully trained as to the, normal . 
functioning of the -restart- points , ; ' / 
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A f rU'stratlon fr equen tl y eKpressed b^f th^ C haiiuti staff 
rnembers is. tfiat bhey recei Insuf ftci en* inro^^ia tion frorri 
PLATO •/system sfcaff when, they inquired ft bout tht reasons for- 

' Inter ruptlcns of service: tlii est Irnste d aength- of the break 
In service, fcype of; probl^iii, action b et ng' tsk^n, or- related 
matters, ^ The ■j.nstruo tors found no relief in ansTOrs that 
.. they .considered v^ague and lacking substantive In formstlon.- 
Because thef r#sc ted ratheT subjec tlv el y , they often fait ^ 
that the P LA" TO computer's operator and other systern stsfr 
urer-e unaware of th.e consequences of i nt^r rupte d airvlce. 

»The instructors gave the iCTpressLorx thai they feat tha-t 
Chanute In partic ul ar ' waf leing ylc tt m^l sed: Do nV.t. they 
realize _we. hsv&^a classroom fuLl of a tudent© up hare?"' was 
a. remark 'made by several of the staff dcjrlng a group 
t ntcrvie w. - ' . ' ^ 

Leaving aside' jtheDbvdous fact thataentral systern 
failures affect all users^^ nob mere ly thos.e at ore sltej 
there may have be en ,1 egl ti^ate ground s here- for ejcpeottng 
Improved feedback stout the sntloipat^d dura tlcn .of the 
d ov^^ntlrne , StnGe the tirne fthst these In struQ to f opln tons 
w^re gatliered, a dei/lce ha been im pi ^mented to Indicate 
t his informatio n. A CER L repdr t^ de al s w^ith th^ problem of^ 
r eporting rel iabillty ( A vner ^ i 978) . 

The instructors fel t that sy st^m f sH ur es were a 
serious problem for students^ Howfe^i/er, ther€ v^as Little 
understQndLrig of tha pos sible r ea sons for these tnter- 
rtjptions. Even trie usual preventive rualnt en ance time ( 0500- 
07^0 every day) was viewed " orit 1g al ly "Don^'t the^know 
that ^ want to run students earlj In .the nio jningT^ mig ht 
.sum up their opaieetive rejoinder, 'This s art€ f eell ng alout 
, S5fstem. interr uptlons in get^eral was eMpre-ssed in an on-r-lire 
survey (Avh er , 1976 s). Firteen CHanute in st ructors wer e 
asked to respond to an attitude survey usi^g .this same 
■ Instrunient: of the t&fi respo nd eri ts^^ six liistructor s felt 
that system inter ruptLon a v/er e a minor problem whil e foiir 
considered thm to toe a maj or 'problem (J^able 1>, Therefore^ 
^it^is clear t Jiafc any 1 os t tim e dn servloe, scheduled or not^ 
Resulted in a very neg at iv^ 1 ripressior^'o n the Cha 

The actual student attitudes towar^^ in ■terrijpt io ns of 
service may be different from what wis suggested by trie 
instructors. Prelirnin ary r es ul ts frbrr; t>e analysis of- 
student que St ionnairea in'dl ca te ' tha'6 the influenoe of the 

-c!-ashes may not have been as aubstantiaL as previously 
expected, for more' details oti student- attitude results^- see 

Tetsuoka et al, { 1 978). - , . 
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Table 1: Survey of \AuthDr/InstrijQtor Attitudes 
torw£ird your class, = , 



Suppose in the future you had to teach the course for 
which you had the most PLArO experience. Would you use ^ 
PLATO, again? ; 
Bi never 
; b, probably ndt 

c, not really, sure 
dt probably vfould 
^ e, absolutely 

Potential problems you have 



1 . 

2. 
3. 



5. 
6. 
7. 

8. 
9. 

10, 



I esi gned 



for 



0 

0 
4 

6 

seen with 
no prob 

^ 6 



PLATO 
minor 



lessons not 
sfcMjden ts . ^ 
low quality of lessons 3 
ladk of lessons on desired 2 
top\lGS 

system crashes in the 0 
midd].e of ol asses 
redJilghtlng of terminals* 2 
keeping terminals repaired 0 
having enough terminals " 0 
for- all students 
ECS (ean*t use §11 lessons 0 
needed during class) 
basie dehurnanlzing eharac^ 8 
ter of GoiJiputers. 
. student difficulties in 6 
use of equipment 



prob. major prob 



3 , 


1 


5 


1 


5 


3 


6 




? - 


1 


10 


0 


8 


2 


5 


5 


2 


0 




0 



Telephone line errors interfering with the 
of student key presses between the terrninals and 
computer J ' ^ 



trsn smisalon 
the central 



Potenti al 



benefits of using PLATO 

no evidence 



• 1, 


g Ives ' stude nts ejcperl- 


3 






ence not otherwise 








aval labl e " 






2. 


allows better teaching 


2 






of regular material 






3. 


permits more to be 


.1 


. 6 




coverjed 








saves jtinie of students 


1 


2 


5. 


saves blrne of Instructors 


0 


1 


6. 


gives Instrijctors better 


2 


6 




evidence of student needs, 







ev . clear ev, 
1 

3 

7 • 
9 

■ 2 
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Quality of the 



N.o twl tiistaridl.n| a 
of the system, the les 
favorable Impact on th 
tors at Chariute, ■ Duri 
unanimousl y agreed tHa 
covered all the necess 
areas, A similar resu 
on specific lessons wa 
thirteen instructors w 
naira. Though. pnly fo 
les^ion were average o 
As additional egridence 
form^er Chanute student 
orientation (personal 
member ^ 1 976) * 



During MTC 
character istlcs 
on the students 
after a c^orreot 
and the visual 



Lessons 



ny hardware 
sons themsel 
e studenits, 
ng a group 
t the lesson 
arjf sub j ect ^ 
It was found 
s sent to ea 
ere asked ,to 
ur responded 
r above aver 
, an unsollc 
ha^s confirm 
conifnunlcstl o 



or software dif f Iculti €s 
ves have made a very 
according- to . the instruct 
nter view I the Inst ruo tors 

quality was high and 
matter for the relevant. 

when a questionnaire 
ch. Indiviual instructorj 
fill out the question-- 
J three felt that the 
age In quality (Table 2), 
Ited conversation wl th a, 
ed^ this positive 
n to a CERL staff 



0 b s.er V a tions of stud 
were noted as making 
For eKample / the e 
answer _tQ a questloii 
impact of wleroflolie 
generate enthusiasm. Hawever ^ atudi 
read the feedback to an inoorreGt re 
always .studi^ the "HELP" sequenoes su 
program. The old bronilde about le^d 
seems appropriate here. 



ents, some lesson ^ 
a positive impression 
ornpl Inien tary feedback 

(e. g . ^ "FantastlQ ! 
ir^sges were seeri to^. ^ . 
nts some times failed to 
spohse and they cjld not, 
ggested by the lesson's 
ifig a horse to water 



Table 2: Ean^klng of EigVt Speci flc Lessons ^ 



CategoriesrsS-^ 



1 

2 
3 
4 
5 



unaoceptable as it stands 

acGfptable only^ if substantially improved 

acceptable as is .. ' ^ 

a fairly good lesson ^/ 

one of the best lessons I*va se:eri 



V" - instructor not farniliar with lesson 





In St. A ■ 


rnst. B 


tnst.C 


Inst .D 




emissions (cha3) ' 


i| 


3 


M 


3 , 


3.5 


starter s ( cha41 ) 


5 " 


3 


3 




3.7 


tran smi ssio n Ccha73 ) 


5 




- n 






dies.els Ccha74) 


■ 3 ■ 


,2 


. 3 




3.d 


hydraulics (oha78) 


5 ■ 


2 


2 


5 


3.. 5 


drive shaft CohaBa) 


3 


2 




3 


• '3.0 


pro (cha86) 


3 


2 


3 ■ 


2 


2 -'5 


electricity Cchag?) 


5 .. 


2 


2 




3-2 


Averages 




2.3 


3.1 


■ 3.6 


^ 3-3 



( Table 2 cont .) 



1. ' These particular lessons w^ra selected since 

detailed reviews of them had been prepared by the 
author (Kleoka, lg77a). ]. 

2. The small number of resporidents to the question^' 
nalre makes any CQnclusions drawn from It very 
tentative, 

3t /The data available IndiQate that moat Instructors 
felt ttr'^^lessons were at least satisfaetory in 
quality . \ 

4, A group interview with Chanute authors and 

Instructors revealed little dis satisfaction with the 
lessons except for a lack of enthusiasm for the 
forced review .technique. 

5i The group interview also incluffed Instruc tors who 
did not respond to the ^ questionnaire above'* The 
eonoluslons drawn from that interview support the 
f.' ■ d a ta above * 



Thesa lessons were eritiqued in Kleeka ( 1977a) . 



Students were frequently observed by Chanute and MTC 
staff to be taking p)f tensive notes whlie going through the 
PLATO lessons, Wh q jeried, the instruc tors readily agreed 
that this habit was no^ o^nly tolerated but op.enly encour- 
aged; however ^ the ohecklng of notebooks by the . instruc tors 
was Qorisidered optional^ aGcordlhg'to a Chanute staff ' 
meniber • Also, in^^some cases an Instructor would ey en help a 
student take notes properly so thfet he would not cbntlniJe to 
oopy everything on the screen. When questioned about this, 
several^ instructors suggaated that the, students felt more- 
QdinfDrtable when they had something in & written form that 
they' could take ,wlth them, for " later revl:ew* 

This feeling, of satisfaction when their' well-annotgte.d. 
noteboolcs were at hand tnay have been a contr Ibutihg frotor 
to a positive attitude toward the PLATO system. Also, the; 
lack of a textbook written specif ically, for the topics 
covered in the CBE lessons may have been 'Significant in 
enQouraging extensive note-taking. The students may have 
felt that the material presented on the screen was worth 
transcribing and retaining for future refer ence . ' In 
addition, the lessons on the system were only available to 
students during their CBE olsss periods--fchey had no 
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Qpportunity to come in^ at other times to revilw material for^- 

■ added , com prehension* AU fchese factors played a part in the 
extensive note-staking"^ and there TOre few objections to this 
practice from the staff, ■ / ^ , 

Attitud es of Others • • ' ; ^ ' 

■ _^ In past studies of PLATO usage, the attitude of the ' 
instructor toward the oomputer systejn has b-een shown' to Hav^ 
an effeGt on student attitudes ( Avner , 1 975b ) , 'Consequently, 
this relationship: was Investigated at Chanute In the. pneseht 
sltudy. When instructor's were in tnrvlewed , thef stated that 
they wer-e s.ll very interested in at i;dent opinions -of the 
PLATO , system and solicited such o iin :ons Kegularly .' ' -They * ' 
tried to keep their own feelir^gs tc .heinselves in order to' • 
avoid coloring student attitudes, but in general they had 
rather positive CBE orientation. ' ' ' ' 

A- negative ■ attitude In particular might have a deleter- 
ious erfect' on the Impact of the materials on students. If 
the instructors are not convlnoed of the value of CBE, it is 
possiblr that this feeling will be 'transmitted to the 
students. Since it is unlikely that anyone can be truly 
Impartial and unblasecs, the neutral to posltiva attitude of 
the Chanute instructors is preferred. It is'a definite 
improvement over the Initial lack of enthusiasm that was 
present , among the staff memtier s lecka , 1977b; Dallman, et 
al. , 1977). . " ■ = . - . ; V \ 

^ ' " . ■ . 

. In spite of the fact ttiat most of the Glassrooni 
instruction for the .vatiicle ma inten^anc e.. course is presented 
via PLATO lessons, staff members must still be present with 
the ^^students v/orklng in the dlassroom. The Instructors or 
instructors *\^asslstants CDalLmanet al., 1977) are needed to- 
answer anj questions that eorne up on specifiQ points in the 
lessons as well as to prov Ide -alternative expl anatlons for 
students having difficulty with the standard presentation* 
■Evien .'though they felt, that PLATO instPuGtlon provided a 
standardized 'format C not ^ sub j ec t^o the vagaries of 
instruetDrsJ methods on d iffererit ^days of teachlnjg), they ^ < 
^agr^^ed thatVfchere is stll 1 ro om for each student to get 
individualized help from the instruGtor if needed anA/or 
waii,ted.w 

Contrast the abbv.p pid'ture of instructor attltud^es with 
that' glyen^^ by a former' director ■ of the Instructional Systems 
Development group. He ^r|ued> that the gr'oup-paced mode of^ 
operation is the worst p.ossible for instruGtors since the 
slowest student sets the' pace. The instructor cannot sit ' - 
down with the slower students for review and teach them 
Gartfully--that would genera lly - mean the group 'would .move at 
a still slower rate* .He continued by saying that all.'the - 
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ir>struQtor can do^ls prod the student^ or sit at the * , /" 
;terfnlnsl and give hirn the answers so* the group cm mcive cn\ 
Further'^ the instructor Is no longer the center of attention 
in the el^issroom, no matter what the sub jeo t of His 'lee tur es 
.is (related to the instruGtlonal obJeGtlves or otherv/lse), . 

The loss of the, position of^authority might re^soh^biy tend 
• la; make the instruo tors less enthusiastic about PLATO 
, system * ^ ' * - . - ^ 

RernarkJbly', the attitudes whicH the MTC/PEER Group'' 
found wHen, interviewing instruetorr did not r^fimt the" ■ ' 
pessimlsni suggested by the discussion above nor the 
instruotor' diasatl sfactlon found 'by AFHRL evaluators 
. • • (Dallmap e-t al . , 1977). This dlacrepancy. may .JJd due to th-e ' 
time varlatlGn at'" which the attltud'e meafeuretnen-ls were made. ' 
The-AFHPL evpluators gathered thi'tr d'ata' In February? and 
July of 1975 and the comment' from''the KD 'dhle''f wa*s made -in 
the. sumrner of 1975. . In contrast, the data for this report 
were gathered in Oetober, 1976. Sorne of the problerns with 
the lesaons may have been worked out along with increasing 
familiarity with the system by the instructors — these 
developments may- have helped to im'pro^^e their attitudes in 
time. ' . 

There was general agreernent among the author' artd 
instructor staff that providing more Extended' Co^6 Storage 
(ECS or conputer' memory space) for acoesslrig lessons during 
times of peak usage ,woul^ help alleviate sotne^ dif f leu 1 tie s , 
Certain problenis with iriadequa,te storage' spaGe menttoned by 
the instructors have also been observed by MTC ataff: 
students frequently were unable to proceed. from one lesson 
to another when ECS usage exceeded the base allotment ■ 
guaranteed to the Chanute site for their use. It s&pears 
likely that these problems could be remedied by addtng more 
ECS or sifflilar memory space to the computer or by sohedullhg 
PLATOvgourses at other than peak usage time, a less -likely 
alternative. ' ■ 

Anotner possibility is dlvldlnMthe larger legaoris into 
smaller segrnenbs to fit more easily^ffi'td the limited ECS 
allocatlori. Doing this would also alleviate the mernory 
shortage. As a, eonsequence, . It seems probable that an 
ancrea,s6 Jn available space for accessing lessons would 
improve instruotor arid possibly student attitude^. Of t lie , 
, ten In.struo tors responding to the MTC survey, five felt that 
■ insufficient ECS, was a minor problem while the reit)&-inder 
considered it a major problem (Table i ) . 

Interviews have suggested that instructor attitudes may 
have beeri Influenced by an upper-level adminiatrator who was 
reported to be reluctant to aGcepb the compu;b,er as a 
' suitable vehicle for delivering effective Instruction. This 
reluct'arice was perceived by the instructors and the' , 



authofing staff as a- tendency by the admlnistrgeor in 

question to slmpljf niark time in hopes that the whole CBE 
prograni at CHanufca would Just fade away. The chief 
administrator was not interviewed -so that an independent 
assessment of his attitu'des cannot be given. However, his 
. lack of apparent support^ was widely perceived among those ' 
olosest.to the project. ■ 

No evidence of any "ripple 'effect" was deteGted by -this 
.investigator among' the instructors, but sev.eral lesson 
authors indlcatea. this administrative feeling made them " 
apprehensive, about their status. 

IgQlly jd ^Benefits of System ' " . 

Some indications , of lesson quality can be gained from 
. tile prevlously-me'ntioned .questionnaire as well as interviews 
with the instructors themselves. Although not specifically 
stated by the instructors, it might be corfectly assumed 
• that- riot,, on.lk what Is presented (i.e., technical subjects), 
■ but also the ^Interactive format in which this rnaterlal is 
displayed plays "aMvCmportant role in the positive benefits 
that can be gained. Also,, it was suggested by the 
instructor staff in an Interview, but not actually observed 
,by them, that a siudent might be more inclined to as^ a 
question at the terminal (e.g., the "defi^nition of an 
unfamil-lar term) than he would in the c'l^as'sr-boni' before the 
. critical gaze of his peers. If the CBE trutorial format does' 
4^rIlske• students less Inhibited about the sub;jetfb matter, it in 
' • f sGt is fulfilling, a very useful role, • 

It canridt be 'denied that recreationa.1 uses of the 
computer Qontrlbute to students' positive feelings toward 
the PLATO system. In .fact, the authors and/or instructors 
had . to enforce a pollpy that recreational uses of the system 
wfere not allowed during the class period since they • 
interfered With progress through the assigned lessons— the • 
,sti)den,t,s woyld' rush through the material in order to begin 
playing games, according to Chanute staff. This ihcl in a,tto,n 
to. utilize the systern resources , for recreational uses mfey . 
have been a factor at an 'early stage for a very: , casual 
attitude on the part of the instructors toward, qBE: it was 
aatjsfactory for pi aying- games but :perhaps lidt for more' 
^ serious instructio^^nal purposes. 

The extent to which the students were cognizant of'the 
tndiyidualizlng character of PLATO lessons, can only be 
measured afpproxlmately. However, . some of , the previous 
Gomnients on. their regctlon to feedback indlGate that they 
can appreoiate the „Jnd ividualizing aspects of, a CBE lessoh 
when these are eho ountered . Nevertheless, there is a 
question as to the difficulty . off the reading level of . ■ 



particular lessons* Some InstruGtors felt that the students 
' could read at an acceptable level to understand all the 
lessons J while others we^e less^ certain .r- , 

Conveniently I as part of another stud y ^ an analysis of 
the reading levels in selected lessons was und ertaken 
^ ( "Readability study" by R. A. Avner in Klecka, ig77a) . In 
'that study it was determined that the reading level In some 
WBS approximately three grade levels higher than the 
reading level of a typical Chanute student. Thus the obser- 
vdtions of the instructors to the ef-fect that the lessons 
were of an appropriate level of readability 'seem to be 
eonflrmed. Unpublished studies by the Mlllfcary Training 
Centers and PLATO Educational Evaluation and Research group 
staffs indicated that the reading level Variations from 
lesson to lesson; apparently have a relatively small effect 
, on a broad range of performance' variables, 

III. MONITORING and RECORDING of Sf UDENT/IMSTRUCTdR COMMENTS 

The InstruQtor opinions discussed above were shaped 
through lengthy inter act ion v^lth the: students in their 
courses* These students expr^essed their opLnions either 
drally as they v/ent through their assignments or in written^ 
comments solicited at the end of the course* The oornmuni- 
cation of these remarks will be discussed in more detail 
since they furnished the foundation for much of the material 
in this repo rt . 

Oral Rein ark 5 - ' . ' 

As they^went through their assignments j the students 
were quite e^cpr essl ve " to their peers and to the instructors 
on various^ aspects of the lessons and systeni , ^ For example, 
a system crash, would occasion negative comrnents which were 
VQC-ali'zed loudly enough to, be heard by the instructors 
present t^ , Also,ip, particular frames of a. lesson might elicit 
questions from the student or even exclamations on some 
aspeet of that particular frame or Interaction, Thus^ the 
Instructor present in the . classroom was In an excellent 
position to collect and interpr .et these Infonrta tive 
coinxnen ts. ^, - 

.Writteri Comments 

Two avenues were available Jor students to record their 
comrnents.ln written formr ' . ^ , 

1. a notes file available while the' student was on- 



2. AF form 736 administered at the end of whole course^ 
* .. of instruction . 

In^ addition, an instructor notes ile ("Ghanotes") was - 
vav-ailable for st^ff^use to Insert specif ic comments on 
particular lessons. Each methoT fur niched -different t 
of inforniation regarding the course , par tlcular lessons , or 
the Instructor staff. 

. 'Student notes file .^ Use of the student notes file 
("phastuden t" ) after January 1.^ 1977, served to open up 
another means for obtaining feedback from^ students. It was 
aooesslble by students at any point in the lessons to make 
comments of either a general or spec if ic natur e . Apprd- 
priate encouragement from the instructors and an observed 
willingness on the part of the students to cooperate 
indicated that this means of communication about lesson 
problems would be useful in .making the needed ehanges. 

Points of high student frustration can be readily 
Identified through the student notes mechanism because noises 
initiated by stuc its are automatically labeLed with loca- 
tion information , At the time of this writing, the use ©-f 
the lesson notes .feature at Chanute was still in the early 
stages of implementation . Some of the comments were gener- 
ally favorable^ but theyi like spme derisive ones^ were not 
specific enough to be useful i.e^^, they didn't identify 
strategies that were well-liked and hence should be repll^ ^ 
cated.. Some more recent notes, however, did pertain to 
' specif la rMP^Gts of lessons and may be worth consi- 
dering. ' Examples of the latter are given below, with- the 
names changed toi protect anonymity . . 

^ Figure 1 : Examples of Useful Student NQtes 

chastUdent '2/10/77 11:54 am harris/ spvehr 
lesson: mrouter sitei chanute 10-11 

"^■Concerning, the section on transmissions there should be 
either plato pictures or slides on the location and opera- 
tion of turbines and stator. Diagrams are needed for a 
proper understanding of the operation' of transmi ssions , 

chastUdent 2/15/77 11:54 am blake/ spvehl f ' - ■ : V ' 
lesson: mrouter site: chanute ^0^11 . H 'Uvl 

Ifi^'tiie basic electricity course, ther e aren ' t enoug^h: f x^a^^^ 
pies, on parallel and series-parallel circuits* 'S6.Vi' feel . 
ypu should correct your lesson #lan, ' ^= '" J./^' 



'Course c ritique for m. The. regulation AF dourse • 
critique form (AF form 736) furnished only general comments 
.„on the, particular course, and it was not very liseful- for 
...locating specific problems within .the lessons or in teaching^" 
strategies. Also, the time span between completing the 
lessons and filling out the form made the recall of specific 
comments difficult., The course critiques are all given at 
the end- of- the -entire, coursj , according to a staff member - 
Although any comments are usually better "than TOne at alj^ 
the data presented in these, forms were difficult to evaluate 
due to their general nature . . 

When instructors were queried regarding the usefulness 
of these critiques, there was limited interest in them as a 
tool for corrective .action. It was felt by the evaluator , 
that they were Administered because AF regulations required 
them; but no enthusiasm was evident for analyzing their 
contents. This feeling is probably justifiable considering 
the format as well as the timing: the, form is' administered- ' 
when students have already completed the course and hence 
have little additional interest in it. 

Instructor notes file . A fairly late development in 
the operation of the PLATO-based Training System at 
Chanute was the use of fl group notes- file ("dhanotes") for 
instructors to put in their comments on lessons. These 
notes were read by the Chanute CBE authoriTig staff and the 
recommendations for changes in the lessons were taken under 
advisement. This file offered 'another avenue of re&ording 
and acting on relevan-t remarks. j.. 

Instructors were alsb able to make comments on 
Individual test, ..items and specific student responses to 
these- items by the use of various data collection and' 
managfement files.- For . detailed information on .this subject, 
see "Computer-Aided Management at Chanute," Chapter 2 of 
Klecka (1977b) . 



IV. ■ CONCLUSIONS ^ ' ■ 

As in any situation, the, attitude of the' users and thus 
the benefits derived froiii'-.tlte- system can be improved by 
implementation of certain changes. It is hoped that this 
process..:Will be aided by the following eoncrusions i 

1. interruptions of 'system rervice had a negative 
effect on the attitudes of the instructors' 

2. virtually all instructors surveyed felt that the ' 
Chanute lessens were of average or above average 
pedagogical ,quality;- , ' 
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the attitudes of Instruc to-rs did have a generaXly ■ 
favorable effect on the students , according to 
Chanute , staff; 

in general J according to the instructors ^ the 
students had. a positive attitude toward the PLATO^^ 
system, although there was still some residue ^Qf 
viewing it as experimentai which may have induced a 
slightly more casual attitude; ■ ■ 

up to the tline of the -writing .of thls^re.port ^ 
student comments delivered orally tended' t5 be rnore^ 
specific and therefore more useful for lessDn & 
revision and pedagogical mpdif ications than those 
written down in course critique forma (AF form 736) 

the student notes and lesson file capability 
offered the opportunity for improvement of lessons " 
based on a broader range of specific comments. 
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